---
title: "Google-Agent: block or allow this AI crawler · DotsAgent"
description: "Google-Agent is run by Google and listed under agents. Its robots.txt token, whether it follows the rules, its IP list and how to control it."
url: https://dotsagent.io/agent-ready/bots/google-agent
---

Google · Agents

# What is Google-Agent?

Fetches pages for agents running on Google infrastructure when a user asks them to act. Google says user-triggered fetchers generally ignore robots.txt.

- **robots.txt token**: `Google-Agent`
- **Operator**: Google
- **Purpose**: Agents
- **Obeys robots.txt**: The operator says robots.txt may not apply, or community reports say it ignores it.
- **Documented by operator**: Yes, on the operator's own pages.
- **Published IP list**: [developers.google.com/static/crawling/ipranges/user-triggered-agents.json](https://developers.google.com/static/crawling/ipranges/user-triggered-agents.json)
- **Documentation**: [developers.google.com](https://developers.google.com/crawling/docs/crawlers-fetchers/google-agent)

Google is experimenting with a Web Bot Auth identity, https://agent.bot.goog, for these requests.

## Block Google-Agent from your whole site

`robots.txt`

```
User-agent: Google-Agent
Disallow: /
```

## Allow it, but keep private paths out

`robots.txt`

```
User-agent: Google-Agent
Allow: /
Disallow: /admin/
```

This bot fetches pages for a person, or for an agent acting on one's behalf. Several operators say robots.txt may not apply to such requests, so check the line above and enforce at your firewall if it matters.

## Other bots from Google

[Googlebot](https://dotsagent.io/agent-ready/bots/googlebot)

[Google-Extended](https://dotsagent.io/agent-ready/bots/google-extended)

[Google-CloudVertexBot](https://dotsagent.io/agent-ready/bots/google-cloudvertexbot)

[GoogleOther](https://dotsagent.io/agent-ready/bots/googleother)

[Google-GeminiNotebook](https://dotsagent.io/agent-ready/bots/google-gemininotebook)

[Gemini Spark](https://dotsagent.io/agent-ready/bots/gemini-spark)

[Gemini-Deep-Research](https://dotsagent.io/agent-ready/bots/gemini-deep-research)

[GoogleAgent-Mariner](https://dotsagent.io/agent-ready/bots/googleagent-mariner)

[Add it to a robots.txt in the generator →](https://dotsagent.io/agent-ready/robots-txt)

## Sources

1. [developers.google.com](https://developers.google.com/crawling/docs/crawlers-fetchers/google-agent)/crawling/docs/crawlers-fetchers/google-agent
2. [developers.google.com](https://developers.google.com/crawling/docs/crawlers-fetchers/google-user-triggered-fetchers)/crawling/docs/crawlers-fetchers/google-user-triggered-fetchers

Independent reference for people who build AI agents. Not affiliated with any vendor named here.

© 2026 DotsAgent · Facts checked October 1, 2026