# ACE AI Spark — robots.txt # # NOTE ON GROUPS (fixed 2026-07-29): a crawler obeys ONLY the single most # specific matching user-agent group. The previous file had a bare # "User-agent: Googlebot / Allow: /" group, so Googlebot used that group and # ignored the Disallow rules under "User-agent: *" entirely — /investment-terms # ended up indexed as a result. Do not re-add per-bot groups unless they carry # the full rule set. # # Private routes (investor pages, auth-gated app screens) are kept out of the # index with emitted by # scripts/prerender-routes.ts — NOT with Disallow. Disallow blocks the fetch, # which would stop Googlebot from ever seeing the noindex and leave the # already-indexed URLs stuck in the index. Once Search Console reports them # removed, Disallow rules may be added back below. # # The old "Host:" line was dropped: it is a Yandex extension that Google # ignores, and it was doing no canonical-domain work. www → apex is a 301 # redirect rule in Cloudflare. User-agent: * Allow: / Sitemap: https://aceaispark.com/sitemap.xml