OpenAI
GPTBot
Collects web content that may be used to train OpenAI foundation models.
AI trainingAI training
AI2Bot
Collects web content for training open language models.
Operated by Ai2
See your agent traffic PurposeAI training
HTTP identifierAI2Bot
IdentityVerify beyond the name
THE SIGNAL
What this visit tells you
Dataset collection is distinct from an assistant researching a page for a user.
Collected paths
Crawl volume
Bytes served
Your next move
Review the public content you permit for collection and watch for excessive crawl load.
The technical details
MarkdownHow to identify it
Look for the AI2Bot identifier in a request’s User-Agent. This is a name match, not identity verification. Version strings may change.
How to check identity
A User-Agent match identifies a claimed client. Check the source IP and any operator-published verification method before granting access.
Access and robots.txt
robots.txt behavior is not established by the linked source. Confirm the current policy before relying on an opt-out.
Seeing 403 or 404 responses?
403 means access was denied; 404 means the resource was not found. Compare the public path, request time, edge security event and origin response to find the cause.
Separate intended restrictions and secret-file probes from pages that should work. A User-Agent name alone does not justify allowing a request.
SourcesReviewed 2026-09-14
Identity and purpose are based on these sources. Analytics interpretation and suggested checks are Apostl guidance.
APOSTL PulseSee AI2Bot in context
See their requests. Find the pages that matter.
See your agent trafficKEEP EXPLORING
