bighof Posted August 28, 2005 Share Posted August 28, 2005 does anyone know how 2 block the google, etc. image robots. 1 they use alot of bandwidth if u have lots of images and 2 if u have private images they may not remain private Link to comment Share on other sites More sharing options...
satish Posted August 28, 2005 Share Posted August 28, 2005 does anyone know how 2 block the google, etc. image robots. 1 they use alot of bandwidth if u have lots of images and 2 if u have private images they may not remain private <{POST_SNAPBACK}> There is a file that specified which all spiders are friendly and sessions are not applicale tot hese. Just remove google and other spider names from that file. Satish Mantri Ask/Skype for Free osCommerce value addon/SEO suggestion tips for your site. Check My About US For who am I and what My company does. Link to comment Share on other sites More sharing options...
bighof Posted August 28, 2005 Author Share Posted August 28, 2005 There is a file that specified which all spiders are friendly and sessions are not applicale tot hese.Just remove google and other spider names from that file. Satish Mantri <{POST_SNAPBACK}> where do i find that file and will that only remove the image robot or stop all of google? I only want 2 stop the image part Link to comment Share on other sites More sharing options...
stevel Posted August 28, 2005 Share Posted August 28, 2005 If you have a robots.txt, add this to it: User-Agent: Googlebot-Image Disallow: / Put this before any User-Agent: * you might have. spiders.txt for sessions is a different thing entirely, though you do want to do this by enabling "Prevent Spider Sessions" in admin and using an up-to-date spiders.txt, such as the one I link to below. Steve Contributions: Country-State Selector Login Page a la Amazon Protection of Configuration Updated spiders.txt Embed Links with SID in Description Link to comment Share on other sites More sharing options...
♥PassionSeed Posted August 29, 2005 Share Posted August 29, 2005 If you have a robots.txt, add this to it: User-Agent: Googlebot-Image Disallow: / Put this before any User-Agent: * you might have. spiders.txt for sessions is a different thing entirely, though you do want to do this by enabling "Prevent Spider Sessions" in admin and using an up-to-date spiders.txt, such as the one I link to below. <{POST_SNAPBACK}> :huh: If you do have a robots.txt file, should it be placed in the same directory as the spiders.txt file? Link to comment Share on other sites More sharing options...
stevel Posted August 29, 2005 Share Posted August 29, 2005 No - robots.txt goes at the top level of your web site. For more information, see A Standard for Robot Exclusion. Steve Contributions: Country-State Selector Login Page a la Amazon Protection of Configuration Updated spiders.txt Embed Links with SID in Description Link to comment Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.