At the WebmasterWorld conference in Las Vegas Matt Cutts discussed the webmaster console features of Google Sitemaps. I was very interested in the crawler error reports and thought that they would greatly assist with SEO work. Yesterday, I asked our IT Manager to implement this on our business directory site Jayde.com because Google hasn’t been indexing all of the pages on that site.

Unfortunately, the results from Google’s error report shows very few errors. I was under the impression that Google would report more than just 404’s and provide more hands on reasoning as to why the spider didn’t follow a link to another page within the site. Those are the kinds of ‘errors’ that would be useful to the webmaster. It would be nice if Google could tell us the details as to why their spider stopped spidering after crawling only 30% of a site.

Posted on Wednesday, November 30th, 2005 at 3:26 pm. Permalink