# ClickSnap robots.txt # Canonical domain: https://clicksnap.live # # Public pages live at clean top-level paths (/blog, /docs, /comparison, # /reviews, /privacy, /terms, /license, /studio). Everything under /src/ is an # extension surface — popup, side panel, options, local history — that renders # per-user state and has nothing for a crawler to read. User-agent: * Allow: / Disallow: /src/ # Search engine crawlers User-agent: Googlebot Allow: / Disallow: /src/ User-agent: Googlebot-Image Allow: /store-assets/ Allow: /blog-assets/ Allow: /icons/ User-agent: Bingbot Allow: / Disallow: /src/ User-agent: Slurp Allow: / Disallow: /src/ User-agent: DuckDuckBot Allow: / Disallow: /src/ User-agent: Baiduspider Allow: / Disallow: /src/ User-agent: YandexBot Allow: / Disallow: /src/ User-agent: Applebot Allow: / Disallow: /src/ # AI crawlers and answer engines User-agent: GPTBot Allow: / Disallow: /src/ User-agent: ChatGPT-User Allow: / Disallow: /src/ User-agent: ClaudeBot Allow: / Disallow: /src/ User-agent: anthropic-ai Allow: / Disallow: /src/ User-agent: PerplexityBot Allow: / Disallow: /src/ User-agent: CCBot Allow: / Disallow: /src/ User-agent: OAI-SearchBot Allow: / Disallow: /src/ User-agent: Claude-SearchBot Allow: / Disallow: /src/ User-agent: Claude-User Allow: / Disallow: /src/ User-agent: Perplexity-User Allow: / Disallow: /src/ User-agent: Google-Extended Allow: / Disallow: /src/ User-agent: Applebot-Extended Allow: / Disallow: /src/ User-agent: Amazonbot Allow: / Disallow: /src/ User-agent: meta-externalagent Allow: / Disallow: /src/ User-agent: DuckAssistBot Allow: / Disallow: /src/ User-agent: Bytespider Allow: / Disallow: /src/ User-agent: Cohere-ai Allow: / Disallow: /src/ User-agent: MistralBot Allow: / Disallow: /src/ # Machine-readable directories & AI context: # HTML Sitemap: https://clicksnap.live/sitemap # LLM Knowledge Index: https://clicksnap.live/llms.txt # LLM Full Context: https://clicksnap.live/llms-full.txt # RSS Feed: https://clicksnap.live/rss.xml # XML Sitemap Sitemap: https://clicksnap.live/sitemap.xml