robots.txt tester
robots.txt
User-Agent
URL
Submit
Result:
ALLOWED
DISALLOWED