Advanced robots.txt Generator
Quick Start
Allow All Bots
Block All Bots
Global Directives
Sitemap URL (optional)
Crawl-delay (optional, in seconds)
User-Agent Rules
Add User-Agent Group
Live robots.txt Output
Copy Code