Anthropic · Search
What is Claude-SearchBot?
Anthropic's crawler for search in Claude. It follows robots.txt and has its own token, separate from ClaudeBot.
- robots.txt token
Claude-SearchBot- Operator
- Anthropic
- Purpose
- Search
- Obeys robots.txt
- Yes The operator says it follows robots.txt.
- Documented by operator
- Yes, on the operator's own pages.
- Published IP list
- claude.com/crawling/bots.json
- Documentation
- support.claude.com
Block Claude-SearchBot from your whole site
User-agent: Claude-SearchBot
Disallow: /
Allow it, but keep private paths out
User-agent: Claude-SearchBot
Allow: /
Disallow: /admin/
Other bots from Anthropic
Add it to a robots.txt in the generator →