Robots.txt Generator
Build a robots.txt file with allow/block rules and a sitemap pointer. One set of rules, ready to drop on your server.
Frequently asked questions
What is robots.txt for?
It tells search-engine crawlers which paths they may or may not fetch. It is a polite request, not a security barrier — private content should be protected another way.
What is the sitemap line for?
It points crawlers to your XML sitemap so they can discover every page you want indexed.
Is my input uploaded?
No. The file is generated entirely in your browser.