# Bytespider

Operator: ByteDance
Purpose: Research & data
Reviewed: 2026-09-14
HTTP identifier: Bytespider
robots.txt token: Not specified

## What is Bytespider?

ByteDance crawler listed by Cloudflare in its AI crawler reference.

## How to identify it

Look for the Bytespider identifier in a request’s User-Agent. This is a name match, not identity verification. Version strings may change.

## How to check identity

A User-Agent match identifies a claimed client. Check the source IP and any operator-published verification method before granting access.

## Access and robots.txt

robots.txt behavior is not established by the linked source. Confirm the current policy before relying on an opt-out.

## What it means in your analytics

A Bytespider label indicates claimed crawler traffic. It does not identify a TikTok viewer or establish how a particular page was used.

## Useful measures

Requested paths; Bytes served; Request frequency.

## What to check next

Review crawl volume and the public paths involved before choosing access limits.

## Sources

- [developers.cloudflare.com](https://developers.cloudflare.com/ai-crawl-control/reference/bots/)

Operator facts are source-backed; interpretation and actions are Apostl guidance.

## Related profiles

- [TikTokSpider](https://apostl.dev/bots/tiktokspider)
- [GoogleOther](https://apostl.dev/bots/googleother)
- [GoogleOther-Image](https://apostl.dev/bots/googleother-image)

[Start measuring agent traffic](https://apostl.dev/start/agent-analytics)