♥John W Posted May 9, 2003 Posted May 9, 2003 Hi Everyone, This might be old news to some of you but this page has a list of the web robots http://www.robotstxt.org/wc/active/html/index.html. I'm not sure how up to date it is but it seemed kind of cool to me. I'm not really a dog.
Guest Posted May 14, 2003 Posted May 14, 2003 Link changed to http://www.robotstxt.org/wc/active.html
New 
Recommended Posts
Archived
This topic is now archived and is closed to further replies.