Guest Posted September 2, 2008 Share Posted September 2, 2008 The google bot seems to be hanging out on my site for over 6o hours consistantly. I never visit the who's online without seeing googlebot there. It also goes through the checkout. Can someone give me some advice as to what my sitemap and robots.txt is doing wrong that is allowing this behavior? I've got cDynamic Meta tags and Dynamic SEO URLs installed. Thanks in advance. Link to comment Share on other sites More sharing options...
sLaV- Posted September 2, 2008 Share Posted September 2, 2008 Have u installed the latest spiders.txt ?? Updated spiders.txt Also in your admin section under Configuration and My Store ... goto Sessions and ensure Prevent Spider Sessions is set to true Link to comment Share on other sites More sharing options...
Guest Posted September 2, 2008 Share Posted September 2, 2008 Have u installed the latest spiders.txt ?? Updated spiders.txt Also in your admin section under Configuration and My Store ... goto Sessions and ensure Prevent Spider Sessions is set to true Let me go check on that stuff...thanks! Link to comment Share on other sites More sharing options...
Guest Posted September 2, 2008 Share Posted September 2, 2008 Well, prevent spider sessions is set to true. I'll make sure that I have the updated spiders.txt Link to comment Share on other sites More sharing options...
Guest Posted September 2, 2008 Share Posted September 2, 2008 Well, the spiders.txt I had did have ebot and obot so it should have prevented googlebot from doing what it did. I'm at a loss. I did update the file. Link to comment Share on other sites More sharing options...
New 
Recommended Posts
Archived
This topic is now archived and is closed to further replies.