# robots.txt for prinpreajma.ro (Main Platform & Tenant Sites) # Standards & Policy: SEO_Master_Architect # ----------------------------------------------------------------------------- # 1. Search Engine Crawlers (Google, Bing, Apple, DuckDuckGo, Yandex) # ----------------------------------------------------------------------------- User-agent: Googlebot User-agent: Bingbot User-agent: Slurp User-agent: DuckDuckBot User-agent: Baiduspider User-agent: YandexBot User-agent: Applebot Allow: / Disallow: /secrets/ Disallow: /tools/ Disallow: /docs/ Disallow: /*.env* # ----------------------------------------------------------------------------- # 2. AI Search & Citation Agents (SearchGPT, Perplexity, Claude, Gemini) # We WELCOME AI agents to index, summarize and cite local Romanian businesses! # ----------------------------------------------------------------------------- User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: GPTBot User-agent: PerplexityBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: Google-Extended User-agent: Applebot-Extended Allow: / Allow: /llms.txt Allow: /llms-full.txt Allow: /data/index.json Disallow: /secrets/ Disallow: /tools/ Disallow: /*.env* # ----------------------------------------------------------------------------- # 3. Default Crawlers # ----------------------------------------------------------------------------- User-agent: * Allow: / Disallow: /secrets/ Disallow: /tools/ Disallow: /docs/ Disallow: /*.env* # ----------------------------------------------------------------------------- # 4. Sitemaps & Machine-Readable AI Context Manifests # ----------------------------------------------------------------------------- Sitemap: https://prinpreajma.ro/sitemap.xml # LLM Discoverability Manifest (Answer.AI Standard): # https://prinpreajma.ro/llms.txt # https://prinpreajma.ro/llms-full.txt