amphead Posted August 7, 2004 Posted August 7, 2004 Hello, Anyone have any suggestions as to what to put in my spider text file to block Yahoo Spider from getting OSCid's. This is whats in my web log: 66.196.90.159 - - [28/Jul/2004:22:35:59 -0400] "GET /shipping.php?osCsid=xxxxxxxxxxxxxxx HTTP/1.0" 200 14416 "-" "Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)" Thanks
niknakgroup Posted August 7, 2004 Posted August 7, 2004 Try adding the sid killer contrib: Sid Killer Contrib Should do the job nicely for you! B) Please note - if I have suggested a contrib above, it doesnt mean it will work! Most of the contribs are not ones I've used, but may be useful for your particular problem.... Have you tried a refined search? Chances are your problem has already been dealt with elsewhere on the forums..... if (stumped == true) { return(square_one($start_over) } else { $random_query = tep_fetch_answer($forum_query) }
-=neo=- Posted August 7, 2004 Posted August 7, 2004 Yes, Sid Killer is a necissary evil... I had the same problems but sid killer is the simple answer. -=neo=- The problem with winning the rat race is at the end you're still a rat.
amphead Posted August 7, 2004 Author Posted August 7, 2004 Thank you. Do you use the "Sid Killer" and the "Prevent Spider Sessions" in the Admin of do your turn in off. I think my understanding was that the Sid Killer was not necessary with OSC 2.2 MS2 and it was just a matter of editing the spider text file.
-=neo=- Posted August 8, 2004 Posted August 8, 2004 Hey Amphead I'm going thru the same thing right now. I tried to put a allprods link on the home page and go with a sid killer on that end so the spider would pull my products from that link but I have some other issues with the spiders like MSNBot who index me and do it so fast they take down my site. So I'm going to go with a sid killer but I'm so heavily modified it's gonna be a task. If Sid Killer comes with ms2 I'd like to know also. It would save me some time. The problem with winning the rat race is at the end you're still a rat.
New 
Recommended Posts
Archived
This topic is now archived and is closed to further replies.