ClaudeBot:
what it is and how to verify it.

ClaudeBot is Anthropic’s training crawler. It collects publicly available web content used to train and improve Claude foundation models. Like GPTBot for OpenAI, it works on its own crawl schedule and has no connection to any live user session — a ClaudeBot hit is corpus collection, not a reader.

Anthropic commits to transparent, non-disruptive crawling: ClaudeBot respects robots.txt directives (including Crawl-delay) and anti-circumvention measures like CAPTCHAs. Disallowing it signals that your future content should be excluded from training datasets.

The trade-off mirrors GPTBot: allowing ClaudeBot lets your product facts, docs, and expertise shape what Claude models know natively; blocking it keeps content out of training but does not affect whether Claude’s live search cites you — that is Claude-SearchBot’s job.