Google · Search
What is Googlebot?
Google's main crawler for Google Search. It follows robots.txt, and Google publishes its IP ranges.
- robots.txt token
Googlebot- Operator
- Purpose
- Search
- Obeys robots.txt
- Yes The operator says it follows robots.txt.
- Documented by operator
- Yes, on the operator's own pages.
- Published IP list
- developers.google.com/static/search/apis/ipranges/googlebot.json
- Documentation
- developers.google.com
To refuse Gemini training without leaving Search, disallow Google-Extended instead of Googlebot.
Block Googlebot from your whole site
User-agent: Googlebot
Disallow: /
Allow it, but keep private paths out
User-agent: Googlebot
Allow: /
Disallow: /admin/
Other bots from Google
Google-ExtendedGoogle-CloudVertexBotGoogleOtherGoogle-AgentGoogle-GeminiNotebookGemini SparkGemini-Deep-ResearchGoogleAgent-Mariner
Add it to a robots.txt in the generator →