Crawlers and technical
What is ClaudeBot?
ClaudeBot is a crawler user-agent associated with collecting web material for model development.
It should not be treated as a universal name for every retrieval route used by an assistant. Training collection and live search are different activities.
Crawler controls express access preferences for the named agent. They do not establish what a generated answer will contain.
In Seenford
In Seenford, ClaudeBot is technical context rather than a verdict: answers from Claude are checked as part of the six-engine set.
Example
A site owner sets a specific robots.txt rule for ClaudeBot.
Related terms
Updated
See what AI says about your brand →