# AI Crawler Directives for Mike Fluff - Business Doctor # https://www.mikefluff.com/robots-ai.txt # Supplementary AI-specific guidance. Standard robots.txt remains authoritative. # OpenAI User-agent: GPTBot Allow: / Disallow: /api/ Disallow: /_next/ User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / # Anthropic User-agent: ClaudeBot Allow: / Disallow: /api/ Disallow: /_next/ User-agent: Claude-User Allow: / # Google AI User-agent: Google-Extended Allow: / Disallow: /api/ Disallow: /_next/ # Perplexity User-agent: PerplexityBot Allow: / Disallow: /api/ # Common Crawl User-agent: CCBot Allow: / Disallow: /api/ Disallow: /_next/ # Other AI crawlers User-agent: Bytespider Allow: / Disallow: /api/ User-agent: Amazonbot Allow: / Disallow: /api/ User-agent: Applebot-Extended Allow: / Disallow: /api/ User-agent: meta-externalagent Allow: / Disallow: /api/ # Default for unlisted AI crawlers User-agent: *-ai Allow: / Disallow: /api/ Disallow: /_next/ # Sitemap Sitemap: https://www.mikefluff.com/sitemap.xml # See /ai.txt for content usage permissions and restrictions. # This file supplements but does not replace robots.txt.