Jump to content
  • Checkout
  • Login
  • Get in touch

osCommerce

The e-commerce.

robots.txt - probably a simple question


andrew71

Recommended Posts

Posted

I have my admin section renamed, plus it is password protected by the .htaccess file.

 

In robots.txt, my renamed admin area is disallowed, but I've realised that as the robots.txt file can be read by anyone, it wouldn't be too hard to work out what the admin folder is called.

 

The question is basically - is there any point in having the renamed admin area listed in robots.txt? As it's password protected and there is no link to it from the main site, a spider or bot wouldn't find it, would they?

Posted

The question is basically - is there any point in having the renamed admin area listed in robots.txt? As it's password protected and there is no link to it from the main site, a spider or bot wouldn't find it, would they?

 

Correct. You should not put the renamed admin directory into the robots.txt file.

 

And if you're interested, the IP Trap add-on blocks IP addresses of spiders and hackers that use the robots.txt file to harvest directory structure information.

 

EDIT: If you use IP Trap, you may find this post to be helpful.

Check out Chad's News.

Archived

This topic is now archived and is closed to further replies.

×
×
  • Create New...