Generate an ai.txt file to quickly and definitively manage which AI bots and data scrapers are allowed to access your website content.
Specify your preferences below to generate the appropriate directives for AI bots.
Select bots to block:
User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: ClaudeBot Disallow: /
An ai.txt file is an emerging initiative, similar to robots.txt, specifically designed to address the modern wave of AI bots, LLM crawlers, and data scrapers that regularly index site data for training.
While robots.txt handles traditional search engines, ai.txt gives you granular, explicit control over whether you consent to having your data used to train AI models by companies like OpenAI, Anthropic, or Google.
Check out our other free tools to boost your SEO and AI integrations.
Get your comprehensive Hybrid SEO Audit in less than 2 minutes. Stop guessing, start ranking.