A Useful Tool

gdfwilliams · February 5, 2003

I recently came across this tool which calculates your page size. More interestingly, it also displays a list of all of the URLs on your pages, AS THEY'LL BE SEEN BY SPIDERS.

I thought that I had successfully prevented appending OSDsid values for spiders, but with cookies off, it turned out ONE of my links was still attaching an OSCsid. I checked out a few of the sites listed in some members' profiles and was suprised to see how many haven't implemented fixes. Not much worse than finally getting good search engine placement, only to force all traffic from that site into the same cart!

Check out your site at:

http://www.searchengineworld.com/cgi-bin/page_size.cgi

The above site also has some other useful tools like info about your robots.txt file.

(For more info on OSCsid/Spider issue, visit Ian's SID Killer and download this contribution.)

toolcrazy · February 5, 2003

I've got Ian's loaded v4 that has the sid killer in place. I am still getting SID's. mmmmm! I wonder which crawler this site is using. I know that you will get sids with cookies disabled. I also noticed that if you login the sids go away.

gdfwilliams · February 5, 2003

There is a step to Ian's SID Killer that should prevent SIDs with cookies off. My site, http://www.tibetcollection.com, does not display any SIDs with or without cookies until you have made it through the log in process. By that point, you know you're not dealing with a spider, so SIDs are OK (until someone posts one on a forum somewhere :? ).

toolcrazy · February 5, 2003

Do you know what's missing? The sid killer was installed by Ian himself, so I was under the impression that it was enabled. I am not familiar with the tech so I don't know how it is supposed to work. So, it may be working just fine and I don't know it. :?

gdfwilliams · February 5, 2003

Check out the SIDKiller thread above and make sure to include the Buttons to Forms contibution. Then, ask Ian, I guess! :)

Ian · February 5, 2003

:oops:

I was going to post something about this on my forum. Double check includes/functions/html_output.php

Make sure that

global $kill_sid follows the function declaration.

wizardsandwars · February 5, 2003

Ian, does you sid killer now implement the buy now buttons to forms?

If not, those sid's could be on the buy now buttons.

Ian · February 5, 2003

Chris,

No it doesn't. of course you can add that contribution separately. There is also another probelm concerning languages. These too can be selected without a form action. As the language is stored in a session then my sid killer needs to enable sid's to keep the store language going.

To tell you the truth I've done very litle work on this recently. I had meant to address the language/currency problem.

I haven't for two reasons.

1) there are only 24 hours in a day :lol:

2) I was waiting to see what was going to happen with Harald's cookie security proposal, as this would make my code completely redundant.

networkdad · February 5, 2003

Woohoo! No SID's!

wizardsandwars · February 5, 2003

Ian,

I know what you mena. The more I work, the longer my list of things to do gets. I just thought I'd throw that out there as an explaination for ToolCrazy.

I'm actually just getting around to installing your SID contribution tonight. Up until now, I've been using my hack, but I found out using this tool that the 'ip' portion of that code isn't working at all, only the User Agent part is. So I'm blocking SIDs from Google, but not all spiders. So, as I've maintained all along, your solution is better, I just havn't had time to put it in. Since it's costing me good listings, though, I need to make time.

Thanks for the great work, BTW.

Ian · February 5, 2003

Chris,

No problem,

Maybe I should get in touch with Joshua to combine my sid killer with his 'buy now' form contribution.

The language problem is fixable, simply by making it a form submit action.

Regardless, I'll try and post an update to my code as originally I said that it should be put at the end of application_top, concensus now says it should be moved to just before the first call to the breadcrumb code in application_top as this calls tep_href_link.

Mr 'waiting' says he spends a couple of hours a week answering questions. HA, takes me that long just to download the help requests I get :lol:

mugitty · February 6, 2003

Ian;

Where exactly are you saying your code should be inserted when you say

concensus now says it should be moved to just before the first call to the breadcrumb code in application_top as this calls tep_href_link

My first breadcrumb call is

require(DIR_WS_CLASSES . 'breadcrumb.php');

 $breadcrumb = new breadcrumb;

 $breadcrumb->add(HEADER_TITLE_TOP, HTTP_SERVER);

 $breadcrumb->add(HEADER_TITLE_CATALOG, tep_href_link(FILENAME_DEFAULT));

Do I want it before the entire block or after the 'require' statement?

Ian · February 6, 2003

Put the code in just after

$breadcrumb = new breadcrumb;

HTH

toolcrazy · February 6, 2003

This is the only instance of $kill_sid in my html output.

// Add the session ID when moving from HTTP and HTTPS servers or when SID is defined

   if ( (ENABLE_SSL == true ) && ($connection == 'SSL') && ($add_session_id == true) ) {

     $sid = tep_session_name() . '=' . tep_session_id();

   } elseif ( ($add_session_id == true) && (tep_not_null(SID)) ) {

     $sid = SID;

   }





   if ( (SEARCH_ENGINE_FRIENDLY_URLS == 'true') && ($search_engine_safe == true) ) {

     while (strstr($link, '&&')) $link = str_replace('&&', '&', $link);



     $link = str_replace('?', '/', $link);

     $link = str_replace('&', '/', $link);

     $link = str_replace('=', '/', $link);

$separator = '?';

 }

   if (isset($sid) && ( !$kill_sid ) ) {

     $link .= $separator . $sid;

   }



   return $link;

 }



////

global $kill_sid follows the function declaration

I'm still learning PHP so I'm not quite sure what you mean above.

Thanks for the help.

mugitty · February 6, 2003

Steve;

I just finished setting this up and it seems to be working OK for me.

In the catalog/includes/functions/html_output.php, find:

(around line 20 in mine)

// The HTML href link wrapper function

 function tep_href_link($page = '', $parameters = '', $connection = 'NONSSL', $add_session_id = true, $search_engine_safe = true) {

add this line immediately after

global $kill_sid;[/b]

and then, around line 67, change the existing 'if' statement to read:

    if ( (isset($sid) ) && ( !$kill_sid ) ) {

   $link .= $separator . $sid;

   }

And then, of course, the previously mentioned changes to catalog/application_top.php

mugitty · February 6, 2003

Sorry, ignore the closing bold tag that was in the previous post :oops:

(I simply must hire a proofreader)

toolcrazy · February 6, 2003

I got it, no SIDs. Thanks to you all!!!!!!! IT WORKS!!!! :lol: :lol: :lol: :lol:

fsiano · February 6, 2003

Can someone please help me understand the whole sid and why it needs to be killed so bad? I understand that is supposedly categorizes you site incorrectly in engines, or that is some form or anotherr doesn't help your situation.

Anyone just really quick help me understand atleast how to rid of them and what the absolute benefit is.

Thanks

Frank S

gdfwilliams · February 6, 2003

Frank -

Who's who during the checkout process is tracked by SID. If two users are assigned the same SID (as will happen if google's link to your site includes a SID), then you would see some very bad things start to happen in the cart. Likely scenarios: users see each other's info or end up with a "community cart".

SIDs do expire, so it's possible that such a link might not cause concern for a while, but 2 or more visitors to your site through the same link will make for problems.

See the thread Showstopper - Privacy Violation for lots more info.

- GDW

TartanTrader · February 7, 2003

Hi

I was reading this thread because at the moment I have a serious problem with the Google Spider in my shop and currently have over 440 sessions running. I have tried to install the sid kiliier but it has seemed to make it worse not better. I have taken the "Buy Now" buttons away and I think I have everything else set right.

I am not a php or cgi or html or any other sort of programmer, I am using snapshot 20020808, if that helps.

Ian

you said

Double check includes/functions/html_output.php
Make sure that

global $kill_sid follows the function declaration.

I have just searched my file and don't have "declaration" is this because I am using a diferent snapshot to you ?

Hope someone can help

Thanks

Phil

Ian · February 7, 2003

global $kill_sid follows the function declaration.

It's cumputer speak. See muggity's post (about three up from here) which explains exactly where th code should go.

TartanTrader · February 7, 2003

Hi Ian

Like this you mean

// The HTML href link wrapper function
function tep_href_link($page = '', $parameters = '', $connection = 'NONSSL', $add_session_id = true, $search_engine_safe = true) {

global $kill_sid;

I have had this in for weeks and it does not seem to have made any difference

TartanTrader · February 7, 2003

with regard to the following

and then, around line 67, change the existing 'if' statement to read:
Code:

if ( (isset($sid) ) && ( !$kill_sid ) ) {

$link .= $separator . $sid;

}

I can't identify where this is so I am not willing to make a blind change

Ian · February 7, 2003

The original lines will be

 if ( isset($sid)) {

$link .= $separator . $sid;

}

TartanTrader · February 7, 2003

with regard to the following found it but it was line 50 and was put in place weeks ago so I am not sure why it is not working :( :( :( :( :(

and then, around line 67, change the existing 'if' statement to read:
Code:

if ( (isset($sid) ) && ( !$kill_sid ) ) {

$link .= $separator . $sid;

}

A Useful Tool

Recommended Posts

gdfwilliams

toolcrazy

gdfwilliams

toolcrazy

gdfwilliams

Ian

wizardsandwars

Ian

networkdad

wizardsandwars

Ian

mugitty

Ian

toolcrazy

mugitty

mugitty

toolcrazy

fsiano

gdfwilliams

TartanTrader

Ian

TartanTrader

TartanTrader

Ian

TartanTrader

Archived

Browse

Activity