Weird URL's spidered

[kitchenniche]

Hi,

 

I saw bots spidering URL's like http://www.kitchenniche.ca/coffee-tea-uten..._111.html?sort= at my site. This site works but the correct URL would be http://www.kitchenniche.ca/coffee-tea-uten...s-c-25_111.html

 

Does somebody know where this "?sort=" comes from?

 

thanks a lot

[Jan Zonjee]

Does somebody know where this "?sort=" comes from?

Hover over the Products Name+ and Price in the table heading of the product listing and you will know. Actually, stevel posted how to get rid of the sort links (confusing for the search engines and even you didn't knew about the feature so what about your customers) a couple of months ago.

[♥Vger]

You must install the large spiders.txt file available from Contributions, and then make sure that 'Prevent Spider Sessions' is set to true in your osC admin panel under Configuration --> Sessions.

 

What's happening is that spiders are creating sessions and adding items to a shopping cart, which is how you are getting that url.

 

Vger

[kitchenniche]

You must install the large spiders.txt file available from Contributions, and then make sure that 'Prevent Spider Sessions' is set to true in your osC admin panel under Configuration --> Sessions.

 

What's happening is that spiders are creating sessions and adding items to a shopping cart, which is how you are getting that url.

 

Vger

<{POST_SNAPBACK}>

 

Ok, i'm now using the large spiders.txt and the "prevent spider sessions" is still set to true. I'll see if it works.

 

Thanks a lot :thumbsup:

[kitchenniche]

Ok it seems like the above problem is solved but i see spiders crawling URL's like http://www.kitchenniche.ca/index.php?cName...ts-canjaropener and the weird thing about that is that this link leads to the homepage...

 

any ideas?

 

thanks a lot