# teasa.ai — public tier is crawlable. Private app routes carry an HTTP # X-Robots-Tag noindex header so crawlers must be allowed to fetch that rule. User-agent: * Allow: / Disallow: /api/ Disallow: /v1/ # Every page's "Report illegal content" link carries that page's URL, one privacy # policy address per page. Disallow: /*?content= # Bing follows only its own group, so it repeats the rules above. Character pages # are noindex while CHARACTER_PAGES_INDEXED is off and took a fifth of Bingbot's # fetches; Bing spends that crawl on Stories and guides instead. User-agent: bingbot Allow: / Disallow: /api/ Disallow: /v1/ Disallow: /*?content= Disallow: /characters Disallow: /en/characters Disallow: /ja/characters Disallow: /ko/characters Disallow: /zh-CN/characters Disallow: /es/characters Disallow: /pt-BR/characters Disallow: /fr/characters Sitemap: https://teasa.ai/sitemap.xml #DaumWebMasterTool:53eff85fb904dbb5e3d21ef536d9bc9b3046293dbaaff791dd9f1ee563d920a0:Wz/rfTo9osfCpgVJS36Djg==