Create a simple robots.txt file with allow, disallow and sitemap directives.
FREE ONLINE TOOL
Robots.txt Generator
Create a simple robots.txt file for your website.
Robots.txt Generator
How to use this tool
Enter the requested information, generate your result, then review and edit it before publishing or using it on your website.
Related tools
Explore more free SEO, content, social media and website tools on our SEO tools collection.
Frequently Asked Questions
What is robots.txt used for?
Robots.txt provides crawler instructions for paths on a website. It is not a replacement for authentication or access control.
Does robots.txt guarantee that a page will not appear in search?
No. Blocking crawling is different from controlling indexing. Use appropriate indexing controls when needed.
