# robots.txt for YAPL # https://www.robotstxt.org/robotstxt.html User-agent: * # Machine-readable AI usage preferences (https://contentsignals.org/) # search = index for search results (incl. AI-powered search) # ai-input = use as grounding/input for AI answers (assistants, RAG) # ai-train = use for AI model training Content-Signal: search=yes, ai-input=yes, ai-train=yes # Allow public pages only Allow: /en$ Allow: /tr$ Allow: /en/ Allow: /tr/ Allow: /en/legal/ Allow: /tr/legal/ Allow: /en/login$ Allow: /tr/login$ Allow: /en/register$ Allow: /tr/register$ Allow: /en/docs/ Allow: /tr/docs/ # Disallow all authenticated app routes Disallow: /en/dashboard Disallow: /tr/dashboard Disallow: /en/projects Disallow: /tr/projects Disallow: /en/teams Disallow: /tr/teams Disallow: /en/settings Disallow: /tr/settings Disallow: /en/plans Disallow: /tr/plans Disallow: /en/resources Disallow: /tr/resources Disallow: /en/admin Disallow: /tr/admin Disallow: /en/invitations Disallow: /tr/invitations # Disallow internal/API routes Disallow: /api/ Disallow: /_next/ # Disallow old/removed pages Disallow: /en/coming-soon Disallow: /tr/coming-soon Disallow: /coming-soon # Disallow short false-positive paths (JS bundle fragments) Disallow: /mo Disallow: /en/mo Disallow: /tr/mo # AI Crawler Policy # All AI crawlers (GPTBot, ClaudeBot, PerplexityBot, CCBot, anthropic-ai, # Google-Extended, Applebot-Extended, Bytespider, cohere-ai) inherit the # wildcard User-agent: * rules above. Public content is intentionally # accessible to AI crawlers for GEO/AEO visibility. The Content-Signal # directive above declares the same policy machine-readably. # Curated index: https://yapl.app/llms.txt # Full docs corpus: https://yapl.app/llms-full.txt # Last reviewed: 2026-07-14 # Sitemap location Sitemap: https://yapl.app/sitemap.xml # RSS Feeds # Blog — root feed (English default) # https://yapl.app/feed.xml # Blog — locale-specific feeds # https://yapl.app/en/feed.xml # https://yapl.app/tr/feed.xml # Changelog — root feed (English default) # https://yapl.app/changelog.xml # Changelog — locale-specific feeds # https://yapl.app/en/changelog.xml # https://yapl.app/tr/changelog.xml