Mort-lemur Posted October 28, 2009 Posted October 28, 2009 Hi, Recently I have noticed what I think are spiders (from IP lookup) spending a lot of time on my site adding things to their shopping cart. Do spiders do this? If so why? - Is there any need to be concerned?? Thanks Now running on a fully modded, Mobile Friendly 2.3.4 Store with the Excellent MTS installed - See my profile for the mods installed ..... So much thanks for all the help given along the way by forum members.
Jack_mcs Posted October 28, 2009 Posted October 28, 2009 Recently I have noticed what I think are spiders (from IP lookup) spending a lot of time on my site adding things to their shopping cart. Do spiders do this? If so why? - Is there any need to be concerned?? They shouldn't be able to do that and it is something to be concerned about. Be sure you have the prevent spider option set in admin->Configuration->Sessions and that your spiders file is up-to-date (see the Addons section). Support Links: For Hire: Contact me for anything you need help with for your shop: upgrading, hosting, repairs, code written, etc. All of My Addons Get the latest versions of my addons Recommended SEO Addons
web-project Posted October 28, 2009 Posted October 28, 2009 the msn (location of it in New York) does shopping on my oscommerce installation Please read this line: Do you want to find all the answers to your questions? click here. As for contribution database it's located here! 8 people out of 10 don't bother to read installation manuals. I can recommend: if you can't read the installation manual, don't bother to install any contribution yourself. Before installing contribution or editing/updating/deleting any files, do the full backup, it will save to you & everyone here on the forum time to fix your issues. Any issues with oscommerce, I am here to help you.
Jack_mcs Posted October 28, 2009 Posted October 28, 2009 the msn (location of it in New York) does shopping on my oscommerce installation Then, assuming you have the prevent spiders option on and the spiders file updated, that bot isn't being seen as a spider. You need to fix that because once they get into the checkout system, they get SID's assigned, which will end up in their listings, and you don't want that. Support Links: For Hire: Contact me for anything you need help with for your shop: upgrading, hosting, repairs, code written, etc. All of My Addons Get the latest versions of my addons Recommended SEO Addons
knifeman Posted October 28, 2009 Posted October 28, 2009 Then, assuming you have the prevent spiders option on and the spiders file updated, that bot isn't being seen as a spider. You need to fix that because once they get into the checkout system, they get SID's assigned, which will end up in their listings, and you don't want that. MSN has a secret bot. It hits my site all the time, although not at the moment so I can't give the IP. It will show up as a customer and add one item to the cart then leave. I posted a long time back and somebody replied with a link. It has something to do with comparing the site pages shown to customers versus bots. When it shows up again, I will post the IP. Tim
Guest Posted October 28, 2009 Posted October 28, 2009 MSN has a secret bot. It hits my site all the time, although not at the moment so I can't give the IP. It will show up as a customer and add one item to the cart then leave. I posted a long time back and somebody replied with a link. It has something to do with comparing the site pages shown to customers versus bots. When it shows up again, I will post the IP. Tim I, too, have the mysterious MSNbot coming in my site daily. It puts one item in the cart...different item every time...then vanishes after a couple of minutes. Likes to visit the login page, as well. Prevent Spider sessions has always been set to True and my spiders.txt is up to date. When I catch it again and get the IP address...should I just put it on my list of IPs that are blocked from the site? - Andrea
knifeman Posted October 28, 2009 Posted October 28, 2009 I, too, have the mysterious MSNbot coming in my site daily. It puts one item in the cart...different item every time...then vanishes after a couple of minutes. Likes to visit the login page, as well. Prevent Spider sessions has always been set to True and my spiders.txt is up to date. When I catch it again and get the IP address...should I just put it on my list of IPs that are blocked from the site? - Andrea I cannot find the post that I was involved in before. It looks like when this forum was updated, the older posts are no longer showing in my history. Which is unfortunate! The person that replied in the post also posted a link to a blog or news story. I am having trouble remembering the details. The one thing I remember was that MSN was checking the integrity of your site. if you block the secret bot, then the regular one will stop visiting too. They figure you are hiding something if you block the secret bot. Kinda like the secret shopper, they view your site from a customer perspective and compare it to the view they get as a bot. The bot is not hurting anything and does not index your site. So I just ignore it. Tim
knifeman Posted October 28, 2009 Posted October 28, 2009 MSN has a secret bot. It hits my site all the time, although not at the moment so I can't give the IP. It will show up as a customer and add one item to the cart then leave. I posted a long time back and somebody replied with a link. It has something to do with comparing the site pages shown to customers versus bots. When it shows up again, I will post the IP. Tim Finally found it. Actually was not as long ago as I thought. previous thread Here is the link to the news story that is in the other thread: My link Tim
Guest Posted October 28, 2009 Posted October 28, 2009 Hi Tim, Thanks for the links, I appreciate it! I was a little concerned about it because I had problems with the MSNbot a few years ago. Whatever they were doing was causing my bandwidth usage to go thru the roof. I have a vague memory of putting something in a file...htaccess maybe...to stop it. Can't remember now what I did exactly, but it fixed the problem. So, when I started noticing this bot adding to the cart, I was like...uh oh. What are they doing NOW? Guess I'll just ignore it. I'll keep an eye on it but, ignore it for the most part. - Andrea
New 
Recommended Posts
Archived
This topic is now archived and is closed to further replies.