Crawlers and technical
What is an AI crawler?
An AI crawler, or artificial intelligence crawler, is automated software that fetches web content for purposes associated with AI systems.
Purposes can include collecting training material or supporting search. Different crawlers may have different roles and access controls.
A crawler visit does not prove that content was used in an answer. Crawl permission also does not guarantee retrieval or recommendation.
In Seenford
Why it matters in Seenford: the measured evidence is the engine's answer, with each verdict linked to its exact wording.
Example
A site's access logs show a crawler requesting a public information page.
Related terms
Updated
See what AI says about your brand →