# ClaudeBot

Operator: Anthropic
Purpose: AI training
Reviewed: 2026-09-14
HTTP identifier: ClaudeBot
robots.txt token: ClaudeBot

## What is ClaudeBot?

Collects web content potentially used for Claude model training.

## How to identify it

Look for the ClaudeBot identifier in a request’s User-Agent. This is a name match, not identity verification. Version strings may change.

## How to check identity

Compare the request IP with Anthropic’s current crawler list linked at https://claude.com/robots. The User-Agent alone does not authenticate the request.

## Access and robots.txt

Anthropic documents robots.txt controls for ClaudeBot. Apply rules on each host you manage; this setting is independent of its other crawler identities.

Optional full-site opt-out; merge with existing rules only if intended. Not a security control.

```text
User-agent: ClaudeBot
Disallow: /
```

## What it means in your analytics

Treat repeated crawls as content access, not live Claude users. A training visit does not establish inclusion in a model.

## Useful measures

Crawl volume; Content paths; Response status.

## What to check next

Keep training access decisions separate from the ability of a person using Claude to read your public product pages.

## Sources

- [support.claude.com](https://support.claude.com/en/articles/8896518-does-anthropic-crawl-data-from-the-web-and-how-can-site-owners-block-the-crawler)
- [claude.com](https://claude.com/robots)

Operator facts are source-backed; interpretation and actions are Apostl guidance.

## Related profiles

- [Claude-SearchBot](https://apostl.dev/bots/claude-searchbot)
- [Claude-User](https://apostl.dev/bots/claude-user)

[Start measuring agent traffic](https://apostl.dev/start/agent-analytics)