# Most specific rules first, so parsers that take the first match agree with # Google's longest-match reading. # # The sign-up, sign-in and signed-in pages llms.txt lists as not for indexing # (/setup, /login, /dashboard, /billing, /plans, ...) carry # instead of a Disallow here: a crawler # blocked by robots.txt never fetches the page, so never sees the noindex, and # can still index the bare URL from links. /api/ returns JSON, which has no # for a meta tag, so it stays disallowed. User-agent: * Allow: /api/legal/ Disallow: /api/ Allow: /privacy Allow: /terms Allow: / Sitemap: https://acriumautomated.com/sitemap.xml