jswan Posted April 15, 2003 Share Posted April 15, 2003 Hi: Any reason to not exclude robots from my admin, images, includes, and download folders? I am just learning about this file, so any suggestions would be most welcome. Thanks, Jason Link to comment Share on other sites More sharing options...
M@rcel Posted April 15, 2003 Share Posted April 15, 2003 nope, no reasons. Just exclude them spiders from everything except your catalog! It might be a good idea to use the robot metatags as well: if ($request_type == 'SSL') { echo '<meta name="Robots" Content="NoIndex, Follow">' . "n"; } else { echo '<meta name="Robots" Content="Index,Follow">' . "n"; } Just put this somewhere in the header of each page. Or, if you've installed Linda's metatag controller, in includes/header_tags.php. M@rcel Greetings from Marcel |Current version|Documentation|Contributions| Link to comment Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.