antadam Posted February 28, 2006 Share Posted February 28, 2006 Earlier we had yahoo's bots crap out all our connections to the MySQL database. We're only allowed to have 20 connections at once and it's normally enough. The bots, however, are either staying connected in some way or there are just so many of them spidering the site that they're clogging everything up. Is there anyway to expire their session ids so that the spiders.txt file starts up and their connections are destroyed? On a side note, we have oscommerce 2.2-ms2 installed and after reading the spiders.txt file located in the contributions section, I don't see an administration->sessions option in the admin section. We installed ms-2 when it came out, so was there some update that came out between now and then that all of the sudden included the sessions option in the admin area? tia Link to comment Share on other sites More sharing options...
boxtel Posted February 28, 2006 Share Posted February 28, 2006 Earlier we had yahoo's bots crap out all our connections to the MySQL database. We're only allowed to have 20 connections at once and it's normally enough. The bots, however, are either staying connected in some way or there are just so many of them spidering the site that they're clogging everything up. Is there anyway to expire their session ids so that the spiders.txt file starts up and their connections are destroyed? On a side note, we have oscommerce 2.2-ms2 installed and after reading the spiders.txt file located in the contributions section, I don't see an administration->sessions option in the admin section. We installed ms-2 when it came out, so was there some update that came out between now and then that all of the sudden included the sessions option in the admin area? tia spider sessions need not expire as you should not give them any. Treasurer MFC Link to comment Share on other sites More sharing options...
boxtel Posted February 28, 2006 Share Posted February 28, 2006 spider sessions need not expire as you should not give them any. but spiders do tend to come in groups (cowards really) with each their own ip address. I have a baidu spider (chinese) which actually manages to issue 10 page requests per second for 5 minutes or so and then leaves and then comes back to do the same. This might be a cross-straights issue though. Treasurer MFC Link to comment Share on other sites More sharing options...
antadam Posted March 6, 2006 Author Share Posted March 6, 2006 spider sessions need not expire as you should not give them any. I was not referring to giving them sessions. The spiders files that's associated with oscommerce is suppose to be attainable via Administration->Sessions according to the spiders.txt file in the contribution's section. I cannot find this in our 2.2-ms2 version. Link to comment Share on other sites More sharing options...
New 
Recommended Posts
Archived
This topic is now archived and is closed to further replies.