Googlebot
Crawls pages for Google Search using desktop and smartphone variants.
Web searchRetrieves feeds submitted to Google Publisher Center.
See your agent trafficTHE SIGNAL
Feed retrieval does not show that a reader opened an article.
Validate the submitted feed and inspect errors on its linked article URLs.
Look for the GoogleProducer identifier in a request’s User-Agent. This is a name match, not identity verification. Version strings may change.
Use Google’s published IP ranges for this crawler class and its forward-confirmed reverse DNS procedure.
This user-triggered fetcher may ignore robots.txt. Use server access controls for private content.
403 means access was denied; 404 means the resource was not found. Compare the public path, request time, edge security event and origin response to find the cause.
Separate intended restrictions and secret-file probes from pages that should work. A User-Agent name alone does not justify allowing a request.
Identity and purpose are based on these sources. Analytics interpretation and suggested checks are Apostl guidance.
See their requests. Find the pages that matter.
See your agent traffic