andrew71 Posted July 27, 2010 Posted July 27, 2010 I have my admin section renamed, plus it is password protected by the .htaccess file. In robots.txt, my renamed admin area is disallowed, but I've realised that as the robots.txt file can be read by anyone, it wouldn't be too hard to work out what the admin folder is called. The question is basically - is there any point in having the renamed admin area listed in robots.txt? As it's password protected and there is no link to it from the main site, a spider or bot wouldn't find it, would they?
chadcloman Posted July 27, 2010 Posted July 27, 2010 The question is basically - is there any point in having the renamed admin area listed in robots.txt? As it's password protected and there is no link to it from the main site, a spider or bot wouldn't find it, would they? Correct. You should not put the renamed admin directory into the robots.txt file. And if you're interested, the IP Trap add-on blocks IP addresses of spiders and hackers that use the robots.txt file to harvest directory structure information. EDIT: If you use IP Trap, you may find this post to be helpful. Check out Chad's News.
Recommended Posts
Archived
This topic is now archived and is closed to further replies.