brandonhuston Posted December 31, 2004 Posted December 31, 2004 what is the spiders.txt all about?? brandon
Guest Posted December 31, 2004 Posted December 31, 2004 The file is basically a list of user-agents (i.e. "browser" types). osCommerce uses this list to avoid generating session IDs for all "browsers" of this type. In other words, it keeps search-engine spiders (like googlebot) from logging URLs with session IDs in them. -jared
New 
Recommended Posts
Archived
This topic is now archived and is closed to further replies.