Guest Posted March 6, 2006 Posted March 6, 2006 i know you can create something like secure.mysite.com and ban spiders from there, but what do you do if your certificate is installed on your root site (mysite.com)? eventually, bots will find it.. how does one successfully keep the bots from indexing useless ssl pages?
boxtel Posted March 6, 2006 Posted March 6, 2006 i know you can create something like secure.mysite.com and ban spiders from there, but what do you do if your certificate is installed on your root site (mysite.com)? eventually, bots will find it.. how does one successfully keep the bots from indexing useless ssl pages? robots.txt Treasurer MFC
Guest Posted March 6, 2006 Posted March 6, 2006 my ssl is installed over my entire domain (mysite.com), so how do i use that? the bots will eventually find https://mysite.com, no? i've already banned account.php, etc... all of those types of pages by robots.txt
jasonabc Posted March 6, 2006 Posted March 6, 2006 my ssl is installed over my entire domain (mysite.com), so how do i use that? the bots will eventually find https://mysite.com, no? i've already banned account.php, etc... all of those types of pages by robots.txt Robots do not index SSL pages. You don't have to do anything. Jason My Contributions: Paypal Payflow PRO | Rollover Category Images | Authorize.net Invoice Number Fix
Guest Posted March 6, 2006 Posted March 6, 2006 Robots do not index SSL pages. You don't have to do anything. oh? ;) http://www.google.com/search?hl=en&q=https...le+Search&meta= Welcome to AdWords, Shields Up ... and that's just the first page ;) i come across them on random searches too
jasonabc Posted March 7, 2006 Posted March 7, 2006 they do. Sorry - Mr Vger told me in a thread I started on Jan 8th that "Search engines don't spider https pages, but they do spider http pages" http://www.oscommerce.com/forums/index.php?sho...78entry773078 Vger - any input on this one? cheers Jase Jason My Contributions: Paypal Payflow PRO | Rollover Category Images | Authorize.net Invoice Number Fix
boxtel Posted March 7, 2006 Posted March 7, 2006 Sorry - Mr Vger told me in a thread I started on Jan 8th that "Search engines don't spider https pages, but they do spider http pages" http://www.oscommerce.com/forums/index.php?sho...78entry773078 Vger - any input on this one? cheers Jase nonsense, spider love https pages. Treasurer MFC
New 
Recommended Posts
Archived
This topic is now archived and is closed to further replies.