# AI Crawler Policy for Sondero (https://sondero.ai) # Last updated: 2026-04-29 # Format: https://specs.openai.com/ai-txt (de facto standard) # --------------------------------------------------------------- # Citations: ALLOWED for all major AI search engines. # Training: NOT ALLOWED. Sondero content may not be used to train # foundation models or be ingested into training datasets. # --------------------------------------------------------------- # AI search citation bots — explicitly allowed User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Google-Extended Allow: / User-agent: Bingbot Allow: / # AI training data crawlers — disallowed User-agent: GPTBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Claude-SearchBot Disallow: / User-agent: CCBot Disallow: / User-agent: cohere-ai Disallow: / User-agent: Google-CloudVertexBot Disallow: / User-agent: FacebookBot Disallow: / User-agent: Bytespider Disallow: / # Default for everything else: allow (matches robots.txt) User-agent: * Allow: / # Reference resources Sitemap: https://sondero.ai/sitemap.xml Contact: contact@sondero.ai LLMs-File: https://sondero.ai/llms.txt