Sincraft Posted February 17, 2005 Share Posted February 17, 2005 Is anyone else noticing that spiders are returning to areas you do not want them to be? Like Product_Review.php?lpage=3 etc etc? I have this 'disallowed' in my robots.txt file, however they return with vigorous intent! Is there a contribution that will say, take all requests for a specific file and redirect them back to somewhere more content loaded and friendly? S Link to comment Share on other sites More sharing options...
New 
Recommended Posts
Archived
This topic is now archived and is closed to further replies.