What Is Google-Extended?

Google-Extended is a robots.txt control token that lets a site decide whether Google may use its content to train and ground its Gemini AI models. It is not a crawler, and it does not change how you rank. Google's crawler documentation puts it plainly: Google-Extended "does not impact a site's inclusion in Google Search nor is it used as a ranking signal" (updated July 2026). So blocking it opts you out of Gemini training, while your search visibility stays put.

What does Google-Extended actually control?

Google-Extended governs one thing: whether Google's Gemini AI may learn from and lean on your content. Per Google's documentation, Google-Extended is "a standalone product token" that publishers use to control whether Google trains "future generations of Gemini models" on their content.

Those models power Gemini Apps and the Vertex AI API.

It also covers grounding. Grounding means feeding your page to a Gemini model at answer time to improve accuracy, and Google-Extended controls that use too.

The token is easy to misread as a crawler. It is not one.

Google's own note is explicit. Google-Extended has no separate user agent string of its own, and crawling happens through Googlebot's existing agents.

The token is "used in a control capacity" only. You are setting a permission, not blocking a visitor.

Does blocking Google-Extended remove you from AI Overviews?

No. AI Overviews and AI Mode are part of Google Search, and Google-Extended does not touch Search. Opting out of Gemini training leaves your pages just as eligible for the AI answers that sit on the results page.

This is the trap most owners fall into. They block Google-Extended expecting to disappear from Google's AI answers, and nothing changes, because those answers run on a different control.

The reason is structural. AI Overviews are generated inside Search from indexed pages, so Search's own rules apply. Google's guidance is direct. Robots.txt directives for Googlebot control how your site is crawled for Search. To limit what an AI Overview shows from your pages, you use nosnippet, max-snippet, or noindex.

In our experience auditing sites that want fewer, or more, AI mentions, the first thing we check is which token they actually changed. Blocking Google-Extended to escape AI Overviews is a common and wasted edit.

How is Google-Extended different from GPTBot?

Google-Extended and GPTBot do the same job for different companies. Both are training-only opt-out controls, and neither governs whether an AI search feature can cite you. Each vendor splits its controls into a training lever and a search lever.

Token	Company	What it controls	Search visibility if blocked
Google-Extended	Google	Gemini training and grounding	Unaffected: Search and AI Overviews stay eligible
GPTBot	OpenAI	Training future OpenAI models	Unaffected: ChatGPT search still works via OAI-SearchBot
OAI-SearchBot	OpenAI	ChatGPT search citations	Removed from ChatGPT search answers

The pattern is worth holding onto. Google separates control as Googlebot for Search, including AI Overviews and AI Mode, and Google-Extended for Gemini training and grounding. OpenAI separates it as OAI-SearchBot for ChatGPT search visibility and GPTBot for model training.

Block the training token and you shape what future models learn from you. You do not remove yourself from live AI answers, which the search-side tokens govern. Weighing that trade-off is the whole subject of whether to block AI crawlers.

How do you allow or block Google-Extended?

You control Google-Extended in the robots.txt file at your site's root, the same place you manage any crawler rule. Allowing it needs nothing, because a token is permitted unless a rule disallows it.

Blocking it takes two lines:

User-agent: Google-Extended
Disallow: /

That rule signals that Google should not use your content to train or ground Gemini. It leaves Googlebot, and therefore your Search ranking and AI Overview eligibility, completely alone.

Frequently asked questions

Does Google-Extended affect my Google ranking?

No. Google states that Google-Extended is not a ranking signal and does not change your inclusion in Google Search. It is a separate permission for Gemini training and grounding, handled through a robots.txt token. Blocking it changes nothing about how, or whether, your pages rank in ordinary results.

Will blocking Google-Extended keep me out of AI Overviews?

No. AI Overviews and AI Mode are built into Search, so they follow Googlebot and snippet controls, not Google-Extended. To limit what those features show from your pages, you use nosnippet, max-snippet, or noindex, each of which also affects your normal search snippets. There is no clean way to stay in Search but out of its AI answers.

Is Google-Extended a crawler or a bot?

Neither, strictly. Google-Extended has no user agent of its own and does not send requests. Google crawls with Googlebot's existing agents, and the token only sets a permission for how that content may be used by Gemini. You are configuring a rule, not blocking a visitor.

Should a Malaysian business block Google-Extended?

Usually not, if you want AI visibility. Letting Gemini learn from your content is part of how a brand becomes something Google's AI simply knows. Blocking makes sense mainly for publishers protecting content they sell. For an SME whose website exists to be found, an open door serves the goal better.

What is the difference between Google-Extended and Googlebot?

Googlebot crawls your pages for Google Search, which feeds ranking, indexing, and AI Overviews. Google-Extended is not a crawler at all. It is a permission token that governs whether the already-crawled content trains or grounds Gemini. Block Googlebot and you leave Search; block Google-Extended and you only leave Gemini training.

Setting your AI crawler rules with intent

Storming Solutions runs SEO, AEO, and GEO for Malaysian businesses from Kuala Lumpur, and getting the crawler and training tokens right is part of the technical groundwork under both. We think most AI blocks were inherited from a plugin default or a misread guide, never chosen by the business.

Not sure which tokens your own robots.txt sets, or what they cost you? Ask us through our contact page or on WhatsApp. The free AI Visibility Report reads which AI crawlers and training tokens your site admits or blocks, alongside your core SEO in Malaysia setup.