robots.txt Generator
Free robots.txt for any site
Sitemap URL
Googlebot allowed
Bingbot allowed
Block GPTBot (OpenAI)
Block ChatGPT-User
Block ClaudeBot (Anthropic)
Block CCBot (Common Crawl)
Disallow paths (one per line)
Generate
Your robots.txt
Ad slot, replace with AdSense IDs after approval
Federal contractor? Daily SAM.gov opportunity alerts Sentinelle Signals