Contributions

Features (Category Index)
Search: 

Spider Killer for MS1

based on ideas from http://forums.oscommerce.com/

What does it do:
It t removes the SessionID if useragent is a spider (by a userdefined array) or the IP is in the userdefined banned IPs array

the check is done only once per page (and not a lot of times as in the sugestion of the threads)

If you are using cvs after 19.03.2003 you don't need it any more, cause a similar thing is implemented

Expand All / Collapse All

Spider Killer for MS1 (VS1.2) Henri Schmidhuber 11 Jul 2003

If you're using it, just use the bugfix and the updated spider_configure file.
You don't need this with MS2 and later cause it's intergrated in the cvs in an similar way.

There is a small Bug in the SpiderKiller
I initialized the spiderkiller too late.
I wrote in the installation guide that you should include the spider_configure.php at the end of the application_top.php.
This is unfoutunally too late, cause the links in the navigation bar are written allready.
The installationguide should have been called:
Quote:
- add in your application_top.php after
// include server parameters
require('includes/configure.php')
// Spiderkiller
require(DIR_WS_INCLUDES . 'spider_configure.php');


To check if it's working properly you can enter your browser as spider in the spider_configure file and check if you find any URLs with a sessionid, or you go too:
http://www.webconfs.com/search-engine-spider-simulator.php
Sorry for the bug.
Henri

enhanced spider config file Henri Schmidhuber 26 Jun 2003
Spider Killer for MS1 Henri Schmidhuber 20 Mar 2003
Spider Killer for MS1 Henri Schmidhuber 19 Mar 2003

Note: Contributions are used at own risk.