User-agent: * Allow: / # Keep authenticated and app-only routes out of search Disallow: /auth/ Disallow: /dashboard/ Disallow: /oauth/ Disallow: /protected/ Disallow: /_next/ # Bing / Microsoft (search + Copilot grounding use Bingbot) User-agent: bingbot User-agent: Bingbot User-agent: BingPreview User-agent: MicrosoftPreview User-agent: adidxbot Allow: / Disallow: /auth/ Disallow: /dashboard/ Disallow: /oauth/ Disallow: /protected/ Disallow: /_next/ # AI crawlers - allow public content while keeping authenticated/app routes out User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: CCBot User-agent: anthropic-ai User-agent: Claude-Web User-agent: ClaudeBot User-agent: Claude-User User-agent: Claude-SearchBot User-agent: PerplexityBot User-agent: Perplexity-User Allow: / Disallow: /auth/ Disallow: /dashboard/ Disallow: /oauth/ Disallow: /protected/ Disallow: /_next/ Sitemap: https://querypanel.io/sitemap.xml # LLM guidance: https://querypanel.io/llms.txt # If a WAF/CDN is configured, also allow Perplexity's current published IP ranges: # https://www.perplexity.com/perplexitybot.json # https://www.perplexity.com/perplexity-user.json