inetchoices Posted December 15, 2003 Share Posted December 15, 2003 Howdy all: After setting up my shared SSL in my configure files, I've noticed in User Tracking (a great mod) that google (crawler.google.com any number or proxy.google.com) now create session IDs. Before adding SSL, User Tracking showed google as online as a guest but without a session id. Now here's what I have enabled as far as Admin: 1. Search Engine Safe URLs = True 2. Prevent Spider Sessions = True I'm using osc2.2MS2. Can anyone help me figure out how to stop google from creating session ID's? They are also pulling down my image files even though I have it set to Disallow: /images/ in robots.txt. I am using .htaccess to keep out a number of rude bots who don't pay attention to robots.txt, but I *don't* want to exclude google :( That would be like tossing the baby out with the bath water! Suggestions, Comments, Direction? Khim~ Do not meddle in the affairs of Dragons, for you are crunchy and good with ketchup :-) Link to comment Share on other sites More sharing options...
inetchoices Posted December 15, 2003 Author Share Posted December 15, 2003 Well... I didn't know what else to do so I added "crawler1" - "crawler20" to my spider.txt file. That seems to have done the trick. I don't know why SSL would change whether a spider creates a session ID or not. It doesn't make any sense to me. Khim~ Do not meddle in the affairs of Dragons, for you are crunchy and good with ketchup :-) Link to comment Share on other sites More sharing options...
New 
Recommended Posts
Archived
This topic is now archived and is closed to further replies.