Content-use policy

Google-Extended

Controls content use for Gemini training and grounding; it does not control Google Search inclusion.

Operated by Google

PurposeContent-use policy

HTTP identifierNo separate HTTP user agent

IdentityPolicy control

THE SIGNAL

A policy, not a visit

Do not create a request count for this token. Use ordinary Google crawler observations and review content-use policy separately.

Published robots.txt policy

Underlying crawler requests

Audit the robots.txt policy itself. A zero count for this name in access logs cannot confirm whether the policy is active.

How to identify it

This is a policy identifier, not a distinct HTTP crawler. Do not use it to infer visits from access logs.

How to check identity

Not a request identity: there is no separate crawler to authenticate.

Access and robots.txt

A robots.txt policy token, without a separate HTTP user agent.

Optional full-site opt-out. Merge with existing rules only if intended. robots.txt does not secure private content.

User-agent: Google-Extended
Disallow: /

SourcesReviewed 2026-09-14

Identity and purpose are based on these sources. Analytics interpretation and suggested checks are Apostl guidance.

APOSTL Pulse

See their requests. Find the pages that matter.