Cookie Usage page presented to bots

[jackof]

Hello,

Google Visited my site and indexed about 50 pages. When i checked it through 'user tracking' i found that OSCOMMERCE presented google with 'Cookie Usage' page for more than 10 times.

Is this OK or will it backfire??

Does this has any problem?/

 

How can i prevent it to force that page to BOTS

 

 

Please help

 

Warm Regards,

Jack

[crash3903]

jack

 

if i understand you correctly you are asaying that you have google and it has created a session??

 

what version are you using of osc

 

if you are using anything other than ms2 then you need to install the sid killer and that will remove the osc id's

 

regards

 

mark

[jackof]

Thanks a lot for the reply, Mark

No, i dont mean that. My 'session killer for bots' thing is working fine and i m using the inbuilt feature of MS2 for it. The problem is that when i check the log through User tracking tool in admin, i find that oSC presented google with lots of 'Cookie Usage' page (the file it shows is cookie_usage.php in the catalog directory)

 

Is this a problem? How can i overcome this

 

 

Warm Regards,

Jack

[Pouli]

Jack,

 

I noticed the same phenomenon with other spiders as well.

As far as I understand, the problem is the following:

when a spider is on a product page or any page where it can follow a link to add a product to the cart, whenever it decides to actually follow such a link, it is redirected to the cookie usage page because it does not use cookies nor a session id.

You can simulate this behavior by using Mozilla Firebird (see this thread).

On the other hand, I don't think this is a major issue and I believe it can be addressed by making the appropriate changes to your robots.txt file, but I'm not an expert on this topic. Anyway, I will make some tests, because I find this situation quite annnoying too and I'll keep you posted.

 

Michel

[Pouli]

Oops! I just realized my theory does not work, as the redirection to the cookie_usage.php page happens after a submit in this page, and as far as I know, spiders do not perform such operations. But I haven't found any other way of being redirected to this page... <_<

At the same time, I have noticed that Inktomi also tried to access checkout_shipping.php that only registered users can see. So does this mean that the spiders are scanning the directory? But if so, why would they more often access cookie_usage.php than any other page?

That's a mystery to me.

[jackof]

Thanks Michel for the reply.

I would love if some more members throw some light on this topic.

 

 

Warm Regards,

Jack

[Guest]

My difficulty has nothing todo with spiders but..

My site is not live and I am making some mods.

Whenever I go to login.php on catalog/index.php or account.php in the navbar I wind up on cookie_usage.php. Using both SSL and NONSSL. I've tried this in IE on win2k and galeon on linux, both with no limits to cookies.

 

using ('PROJECT_VERSION', 'osCommerce 2.2-MS2');

 

Just wondering if there is a correlation.