Guest Posted October 8, 2005 Posted October 8, 2005 how is it done? so far, google seems to be the only search engine that specifically tells you how to rid their image bot. will adding a robots.txt file of: User-agent: * Disallow: /images keep away all image bots and NOTHING MORE? i don't want to keep the actual yahoo bot or anything from indexing my entire site... JUST the images folder. at this point i am not 100% keen on how robots.txt works. will blocking these bots from /images make them like my pages less? will it serve them a 404 for all images, thus making them think my site is of less quality or something? can somebody explain this to me?
Recommended Posts
Archived
This topic is now archived and is closed to further replies.