Telling Google How Often To Crawl Your Site- Not A Good Idea After All.

A while back I wrote an article pointing out one of the features available to webmasters at Google Webmaster Central – ability to set a custom crawl rate. At the time I thought it was an outstanding idea. It is still is a good solution should googlebot visit your site too often causing issues with …

Telling Google How Often To Crawl Your Website

If you are using Google Webmaster Tools you are probably aware that, among many things that these tools offer, there is the ability to submit your web site’s sitemap to help Google discover pages on your website. Google Webmasters Tools can also provide some insightful information about your website. Among many different statistics you will …