# AhrefsBot

Operator: Ahrefs
Purpose: SEO analysis
Reviewed: 2026-09-14
HTTP identifier: AhrefsBot
robots.txt token: AhrefsBot

## What is AhrefsBot?

Collects link and web data for Ahrefs and the Yep search engine.

## How to identify it

Look for the AhrefsBot identifier in a request’s User-Agent. This is a name match, not identity verification. Version strings may change.

## How to check identity

Check Ahrefs’ published IP list and forward-confirmed reverse DNS guidance.

## Access and robots.txt

Supports robots.txt and Crawl-delay.

Optional full-site opt-out; merge with existing rules only if intended. Not a security control.

```text
User-agent: AhrefsBot
Disallow: /
```

## What it means in your analytics

A broad web crawl is not necessarily an audit commissioned by your team. Separate it from AhrefsSiteAudit traffic.

## Useful measures

Linked URL failures; Crawl frequency; Origin load.

## What to check next

Compare crawl frequency and backlink destinations. Handle useful retired pages intentionally while keeping probes outside product error reports.

## Sources

- [ahrefs.com](https://ahrefs.com/robot/)

Operator facts are source-backed; interpretation and actions are Apostl guidance.

## Related profiles

- [AhrefsSiteAudit](https://apostl.dev/bots/ahrefssiteaudit)
- [SemrushBot](https://apostl.dev/bots/semrushbot)

[Start measuring agent traffic](https://apostl.dev/start/agent-analytics)