# SemrushBot

Operator: Semrush
Purpose: SEO analysis
Reviewed: 2026-09-14
HTTP identifier: SemrushBot
robots.txt token: SemrushBot

## What is SemrushBot?

Collects web and link data for Semrush analysis tools.

## How to identify it

Look for the SemrushBot identifier in a request’s User-Agent. This is a name match, not identity verification. Version strings may change.

## How to check identity

For unexplained crawling, send the relevant URL and request evidence to bot@semrush.com. A matching name does not authenticate the source.

## Access and robots.txt

Use a SemrushBot robots.txt group to control link-index crawling. Crawl-delay is supported up to 10 seconds; Semrush’s other tools have separate tokens.

Optional full-site opt-out; merge with existing rules only if intended. Not a security control.

```text
User-agent: SemrushBot
Disallow: /
```

## What it means in your analytics

A backlink crawler may revisit old linked URLs. That 404 can reflect a historical link rather than a broken current customer journey.

## Useful measures

Linked URL failures; Crawl frequency; Origin load.

## What to check next

Check whether repeatedly requested missing URLs still have useful inbound links. Fix or redirect relevant destinations; do not redirect every unknown path.

## Sources

- [semrush.com](https://www.semrush.com/bot/)

Operator facts are source-backed; interpretation and actions are Apostl guidance.

## Related profiles

- [AhrefsBot](https://apostl.dev/bots/ahrefsbot)
- [MJ12bot](https://apostl.dev/bots/mj12bot)

[Start measuring agent traffic](https://apostl.dev/start/agent-analytics)