Robots.txt Generator
Generate a robots.txt file for your website. Control crawler access, set crawl delay, and add sitemap URL.
Local processingHow to Use
Enter your input above. The result updates automatically. Use the copy button to copy the result.
Privacy
All processing happens in your browser. Your data is never uploaded to any server.
FAQ
What is robots.txt?
It tells search engine crawlers which pages they can or cannot access.