User-agent: Slurp Disallow: /cgi-bin/ User-agent: ClaudeBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Claude-Web Disallow: / User-agent: SemrushBot Disallow: / User-agent: bingbot Disallow: / User-agent: Amazonbot Disallow: / User-agent: BLEXbot Disallow: / User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: GPTBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: meta-externalagent Disallow: / User-agent: CCbot Disallow: / User-agent: FacebookBot Disallow: / User-agent: Google-Extended Disallow: / Disallow: / User-agent: PiplBot Disallow: / User-agent: meta-webindexer Disallow: /