Googlebot Video

What does Googlebot Video do?

Googlebot Video fetches publicly accessible video pages and media to build and update Google's video index. It powers video-related features in Google Search, including video carousels, video snippets, and dedicated video search results. When your video content is indexed, Google Search links directly back to your source pages, driving referral traffic.

Should I allow and optimize for Googlebot Video to drive organic growth?

Googlebot Video directly feeds Google Search video features, which are among the highest-traffic discovery surfaces on the web. Allowing it means your video content can appear in video carousels, video tabs, and rich snippets, all of which link back to your pages. Blocking Googlebot Video removes your site from these video-specific results entirely. If you publish any video content, allowing this crawler is one of the most straightforward ways to increase organic visibility.

Data Usage & Training

Whether content crawled by Googlebot Video is used to train Google's AI models (such as Gemini) is unclear from public documentation. Google provides a separate robots.txt token, Google-Extended, that lets publishers control whether their content is used for AI training and grounding. If you want to allow video indexing but restrict training use, block Google-Extended while keeping Googlebot-Video allowed.

How Googlebot Video Accesses Content

Here's how Googlebot Video accesses your site and understands your content:

• Fetches video pages and media files via standard HTTP requests
• Identifies itself with the Googlebot-Video/1.0 user-agent string
• Respects robots.txt Disallow and Allow directives for automatic crawls
• Observes Sitemap directives when present in robots.txt
• Does not support the non-standard Crawl-delay directive
• Can be verified via reverse DNS lookup and Google-published IP ranges

Googlebot Video crawls continuously on a distributed, recurring schedule. Crawl rate varies by site, and Google allows site owners to request a reduced crawl rate through Google Search Console.

How to Block or Control Googlebot Video

To block Googlebot Video from crawling your site, add the following to your robots.txt: User-agent: Googlebot-Video Disallow: / To block specific directories while allowing the rest, replace / with the path you want to restrict. For IP-based verification or filtering, check incoming requests against Google's published IP ranges at https://www.gstatic.com/ipranges/goog.json and verify with reverse DNS lookups. Robots.txt blocks crawling but not indexing of already-known URLs. To prevent indexing, use a noindex meta robots tag on the page itself. To control AI training use separately, block the Google-Extended token instead.

Common Issues & Troubleshooting

Watch out for these common problems when working with Googlebot Video:

• Blocking Googlebot-Video in robots.txt prevents crawling but does not remove already-indexed URLs from search results. Use noindex meta tags for that.
• Some bots spoof the Googlebot-Video user-agent string. Verify requests using reverse DNS lookups and Google's published IP ranges.
• Mis-typed robots.txt tokens (e.g., Googlebot_Video instead of Googlebot-Video) cause rules to be silently ignored.
• Incorrect rule ordering in robots.txt can unintentionally block or allow paths. Place more specific rules before general ones.
• Video files behind authentication or paywalls will not be crawled or indexed.
• Confusing Googlebot-Video with the main Googlebot token. Rules for one do not automatically apply to the other.