# SemanticRisk public crawler policy User-agent: * Allow: / # Keep private and operational routes out of search indexes Disallow: /api/ Disallow: /app/ Disallow: /auth/ Disallow: /admin/ Disallow: /dev/ Disallow: /dashboard/ Disallow: /account/ Disallow: /internal/ Disallow: /debug/ Disallow: /health Disallow: /metrics # Allow search and AI retrieval while declining model-training use Content-Signal: search=yes,ai-input=yes,ai-train=no Sitemap: https://semanticrisk.io/sitemap.xml