# Optimsy robots.txt # https://www.optimsy.com # AI policy: https://www.optimsy.com/.well-known/ai.txt User-agent: * Allow: / Disallow: /admin/ Disallow: /dashboard/ Disallow: /api/ Disallow: /auth/ # The four endpoints /.well-known/api-catalog advertises as the PUBLIC API. # Without these the two documents contradict each other: the catalog tells an # agent runtime "here is the machine surface", and robots.txt then forbids # fetching every URL in it. Allow beats Disallow under the longest-match rule # every major crawler implements, so /api/ stays closed apart from these. Allow: /api/tools/etsy-tag-generator Allow: /api/tools/etsy-profit-calculator Allow: /api/mcp Allow: /api/health # Content Signals (contentsignals.org) # Preferences for AI content usage. Content-Signal: search=yes, ai-input=yes, ai-train=no Sitemap: https://www.optimsy.com/sitemap.xml