Jump to content
  • Checkout
  • Login
  • Get in touch

osCommerce

The e-commerce.

robots.txt issue with inktomi spider


GraphicsGuy

Recommended Posts

Posted

I can view the robots.txt file with my browser. The permissions are set to the same as all other web accessible content on the site.

 

But the inktomi (yahoo) keeps trying to access it and instead gets my custom error page (product you are looking for has moved, from a contrib).

 

Has anybody else encountered this?

Rule #1: Without exception, backup your database and files before making any changes to your files or database.

Rule #2: Make sure there are no exceptions to Rule #1.

Archived

This topic is now archived and is closed to further replies.

×
×
  • Create New...