Guest Posted September 2, 2008 Posted September 2, 2008 The google bot seems to be hanging out on my site for over 6o hours consistantly. I never visit the who's online without seeing googlebot there. It also goes through the checkout. Can someone give me some advice as to what my sitemap and robots.txt is doing wrong that is allowing this behavior? I've got cDynamic Meta tags and Dynamic SEO URLs installed. Thanks in advance.
sLaV- Posted September 2, 2008 Posted September 2, 2008 Have u installed the latest spiders.txt ?? Updated spiders.txt Also in your admin section under Configuration and My Store ... goto Sessions and ensure Prevent Spider Sessions is set to true
Guest Posted September 2, 2008 Posted September 2, 2008 Have u installed the latest spiders.txt ?? Updated spiders.txt Also in your admin section under Configuration and My Store ... goto Sessions and ensure Prevent Spider Sessions is set to true Let me go check on that stuff...thanks!
Guest Posted September 2, 2008 Posted September 2, 2008 Well, prevent spider sessions is set to true. I'll make sure that I have the updated spiders.txt
Guest Posted September 2, 2008 Posted September 2, 2008 Well, the spiders.txt I had did have ebot and obot so it should have prevented googlebot from doing what it did. I'm at a loss. I did update the file.
New 
Recommended Posts
Archived
This topic is now archived and is closed to further replies.