Google Reveals Search Process Timelines for Crawling Indexing and Serving

Google has shared new insights into the timelines for its search processes, including crawling, indexing, and serving. The data, presented by Gary Illyes at the Google Search Central Live Deep Dive event in Europe, breaks down the typical and slowest times for each process. According to John Campbell of We Are Roast, this was a highlight of the event, providing fresh information directly from Google's internal analysis.

The crawling process includes several stages, such as discovering new URLs, refreshing known URLs, processing sitemaps, and updating robots.txt files. Typical times range from about 20 hours for URL discovery to 30 days for URL refreshes. The slowest times can extend from weeks to never, depending on the process. Crawl capacity and demand updates can also vary significantly, with the slowest updates taking weeks to months.

Indexing involves rendering, meta and link annotations, and structured data updates. The typical end-to-end indexing time is about 1.5 hours, but it can take months or never happen if there are quality issues. Site moves and canonicalization changes can take from weeks to over a year, depending on conflicting signals. Images and videos can take hours to days typically, but weeks to months in the slowest cases.

Serving updates, such as removal requests, snippet updates, and manual action removals, also have varying timelines. Removal requests in Search Console typically take around 2 hours but can extend to 24 hours. Snippet and title updates usually take 1-2 days but can take several weeks to months. Core updates and spam updates have their own specific timelines, with core updates taking 2-4 weeks to roll out and spam updates rolling out in 1-2 days.