rmsigns Posted June 23, 2008 Share Posted June 23, 2008 hello all, this is my robots file and i'm wondering if someone can let me know if it looks about right? oh and i've read i should rename the robots.txt file.. does that mean i should name it something like... blabla.txt? haha please and thank you m User-agent: * Disallow: /cgi-bin/ Disallow: /admin/ Disallow: /tmp/ Disallow: /images/ Disallow: /admin Disallow: /account.php Disallow: /advanced_search.php Disallow: /checkout_shipping.php Disallow: /create_account.php Disallow: /login.php Disallow: /password_forgotten.php Disallow: /popup_image.php Disallow: /shopping_cart.php Disallow: /catalog/admin Disallow: /catalog/account.php Disallow: /catalog/advanced_search.php Disallow: /catalog/checkout_shipping.php Disallow: /catalog/create_account.php Disallow: /catalog/login.php Disallow: /catalog/password_forgotten.php Disallow: /catalog/popup_image.php Disallow: /catalog/shopping_cart.php Link to comment Share on other sites More sharing options...
Guest Posted June 23, 2008 Share Posted June 23, 2008 First off the robots.txt has to be named robots.txt. I may be wrong on that but don't think so. Secondly and very important rename your admin folder to something else. Not admin_2, new_admin or admin_anything. Then remove it from the robots.txt. Search engines can't find it if there is no link to it. Thirdly why so many admins? Like I said rename the admins and remove them from robots.txt. Keep in mind not all spiders honor the robots.txt file. Link to comment Share on other sites More sharing options...
rmsigns Posted June 23, 2008 Author Share Posted June 23, 2008 hi brian, thanks for responding. not sure why so many admin files.. haha. actually i took it from a contribution as i really don't know that much about it. so i'll go check it now and try to rename my admin and then remove it from the robot file. cheers m Link to comment Share on other sites More sharing options...
rmsigns Posted June 23, 2008 Author Share Posted June 23, 2008 hi brian, thanks for responding. not sure why so many admin files.. haha. actually i took it from a contribution as i really don't know that much about it. so i'll go check it now and try to rename my admin and then remove it from the robot file. cheers m hey brian one more question if you dont' mind. when i go to change the admin file it says in the help section that if you want to rename and keep it in the same directory you need to keep the original. does that mean there will still be a file with the name admin??? what's your suggestion? thanks m Link to comment Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.