I have been studying the Google bots on my site in detail the last couple of months. Their behavior is reminding me strongly of a project where I worked as a project manager. A big project where there had been no architect. A project were the results were not the same every time you ran a query because of

I am not criticizing the Google architecture. Not at all. Almost all Google APIs I have looked at have been great. Very neat. And there is only one API. Not like eBay or Microsoft where everything can be done in at least 10 different ways. And not one of them works 100%.

I am just suspecting that the algorithm has grown too complex. It is very complicated to create a good Search Engine. Google page ranking is still great, but not perfect. The timing of the robots and inclusions/exclusion of pages seems to be very unpredictable. I have implemented sitemaps on my sites but the robot seems to ignore them in some cases. As page rakning will be more and more important for businesses it is going to take a lot effort make sure that page rakning and correct indexing of pages in order to prevent angry companies and lawsuits like this one.

This entry was posted on Tuesday, April 4th, 2006 at 6:42 am and is filed under Google, Search engines, SEO. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.