Mort-lemur Posted May 15, 2010 Share Posted May 15, 2010 Hi, Recently googlebot and its associated IP's have been spending a LOT of time on my site - 15 - 18 hours per day! Is this a good thing or a bad thing? How long do spiders normally spend on a site? Thanks Now running on a fully modded, Mobile Friendly 2.3.4 Store with the Excellent MTS installed - See my profile for the mods installed ..... So much thanks for all the help given along the way by forum members. Link to comment Share on other sites More sharing options...
Hotclutch Posted May 15, 2010 Share Posted May 15, 2010 Hi, Recently googlebot and its associated IP's have been spending a LOT of time on my site - 15 - 18 hours per day! Is this a good thing or a bad thing? How long do spiders normally spend on a site? Thanks It's a good thing if robots are active on your site, esp Googlebot, YAHOO, and MSN. Link to comment Share on other sites More sharing options...
Mort-lemur Posted May 15, 2010 Author Share Posted May 15, 2010 Thanks - Active is one thing - but I think google has moved in ! It seems to be constantly on my site now. Now running on a fully modded, Mobile Friendly 2.3.4 Store with the Excellent MTS installed - See my profile for the mods installed ..... So much thanks for all the help given along the way by forum members. Link to comment Share on other sites More sharing options...
Hotclutch Posted May 16, 2010 Share Posted May 16, 2010 Thanks - Active is one thing - but I think google has moved in ! It seems to be constantly on my site now. It will be good if Google has moved in :) They are spidering your pages and hopefully adding your URLs to the index, which is not a bad thing. Link to comment Share on other sites More sharing options...
NodsDorf Posted May 16, 2010 Share Posted May 16, 2010 I think that is fairly normal (and good). One of my sites that has been out for over 6 years always has 3-7 bots on it at all times. Link to comment Share on other sites More sharing options...
Mort-lemur Posted May 16, 2010 Author Share Posted May 16, 2010 Thanks for the replies - I was getting concerned that the spiders were trapped in some form of loop... Now running on a fully modded, Mobile Friendly 2.3.4 Store with the Excellent MTS installed - See my profile for the mods installed ..... So much thanks for all the help given along the way by forum members. Link to comment Share on other sites More sharing options...
Hotclutch Posted May 16, 2010 Share Posted May 16, 2010 Thanks for the replies - I was getting concerned that the spiders were trapped in some form of loop... You nned to ensure that your configure file settings are correct as well as updated spiders.txt. You could also examine your server log files to see what it is they are crawling. Link to comment Share on other sites More sharing options...
NodsDorf Posted May 16, 2010 Share Posted May 16, 2010 another thought. You can create a Google account for your website which allows you access to the "Webmaster Central" there you can see if they are getting any crawl errors and if so where. Link to comment Share on other sites More sharing options...
New 
Recommended Posts
Archived
This topic is now archived and is closed to further replies.