Skip to main content
GlossaryAI Crawlers

Google-Extended

A user-agent token Google uses to gate content from its generative features (Gemini, AI Overviews) separately from Search.

Also known asGoogle-Extended

Google-Extended is not a separate crawler — it's a robots.txt token you allow or disallow. Allowing it keeps you in Gemini and AI Overviews. Disallowing it removes you from Google's generative surfaces without affecting classic Search ranking.

Most merchants should allow Google-Extended. AI Overviews now intercepts a growing share of category-level queries, and being absent means ceding that surface to a competitor.

In practice

User-agent: Google-Extended Allow: /

Related terms

All terms
Shopify Signals

AI Overviews

Google's generative answer that appears above traditional search results for many queries.

AI Crawlers

GPTBot

OpenAI's web crawler that fetches pages for ChatGPT's retrieval and training data.

AI Crawlers

ClaudeBot

Anthropic's crawler that fetches pages for Claude's retrieval and training.