sam6 Posted March 4, 2004 Share Posted March 4, 2004 how to i tell them not to spider the pages with oscsids it got before i put in user agent i have the user agent in now for yahooseeker/1.1 and i am getting oscsid still i think this is because it spider my site a little before i got the user agent in how can i stop it from referring to the pages with oscsids if it goes to a new page i donot get th oscsid. if i put the user agent in my browser i donot get oscsid. but this spider still shows oscsids alot. should i not worry abot it . i need advice i thought this is a security risk. Link to comment Share on other sites More sharing options...
sam6 Posted March 4, 2004 Author Share Posted March 4, 2004 i guse ill just disallow the spider in my robots txt to prevent oscsids form getting out then i eill re sumbmit to them in a month or so unless sobody can tell me a beter way Link to comment Share on other sites More sharing options...
New 
Recommended Posts
Archived
This topic is now archived and is closed to further replies.