Google Exceptionally Slow Index Times?

[jdwanchalk]

I have about 30 pages added over a week that are not yet indexed on one of my sites. About 10 not indexed on another site, and that too has been at least a few weeks. These sites should be getting indexed much faster. I know some other people are having issues as well.

What the hell is Google caffeine? It does absolutely nothing, and if it does do something it is extremely minute from the perspective of static page indexing.

[Giorgio]

Agree. Have two new sites not being indexed as a whole since July

[rake360]

disagree. I add pages and they are indexed in < 60 seconds.
it's all about site / page authority.

you could try using pingomatic..

[jdwanchalk]

disagree. I add pages and they are indexed in < 60 seconds.
it's all about site / page authority.

you could try using pingomatic..

Posts I can get indexed immediately, I am talking about static pages.

[rake360]

Posts I can get indexed immediately, I am talking about static pages.

posts (on wp as a CMS ) ping automatically.. maybe this is your issue. If so, try pinging the pages.

[Michael Martinez]

Actually, I have noticed an apparent change in Google's indexing patterns across a few dozen sites over the past couple of weeks. It could be due to a readjustment in their PageRank valuations but it might also be tied to the release of Google Instant. They usually recrawl the Web when they release a major update so they can rebuild their databases.

They have moved toward streamlining that process considerably, so they can update small pieces of the index at a time. It is less noticeable. Nonetheless, a lot of blogs seem to be suffering from indexing issues around the time of the Google Instant update. These are posts, not pages, that appear to have slipped through the cracks.

[jdwanchalk]

Bumping this because it is incredible how bad Google is right now with indexing new pages on an old, well established site (and new ones alike).

[Prenut]

Bumping this because it is incredible how bad Google is right now with indexing new pages on an old, well established site (and new ones alike).

It's happening with some of the larger, most established sites. I'm really amazed at how bad Google has become for indexing new pages and recrawling older ones.

[Sebastian]

Yup, agree with Jonathan... It's amazing how awful Caffeine is.

Ever since it rolled out, indexing times have been stretched.

I thought what they might have done is re-prioritized their crawling to favor trusted sites, but not even sure that's the case based on Prenut's observation.

[Prenut]

On a related note, it seems all index pages that have snippets of new news stories are pretty much autorecrawled when there is a new post. Perhaps I will experiment with adding some summaries onto interior pages that will auto update with new posts.