Googlebot using up my bandwidth

[daz_75]

Basically googlebot used 30mb of bandwidth last month, while msnbot only used 2.5mb. Why is it using so much

 

Thanks

 

Daz

[Jack_mcs]

It is just a matter of how much the bots visit and what pages they visit. It is a good thing that google is searching your site so you shouldn't worry about the bandwidth used. However, it is possible for google to get into one of your secured pages which will cause it to loop around in there. That you don't want. If you have a contribuiton like user tracking installed, you can see what it is doing. Just be sure you have Prevent Spiders set to true in admin->sessions. There is also a contribution that changes some buttons to javascript so the bots can't get through. I've never seen a need for this but it might apply in your case.

 

Jack

[daz_75]

Thanks Jack, your a star :thumbsup:

 

I've already got the part in admin set to true after reading a howto page.

 

I've got supertracker installed but im not sure it show the info you are talking about

 

Any ideas which of these would be best?

 

http://www.oscommerce.com/community/contributions,824

http://www.oscommerce.com/community/contributions,1055

 

Cheers

[Jack_mcs]

I think they serve similar but different purposes, although I haven't looked at the updates lateley. You should ask in the support thread for each to see what the actual users recommend.

 

Jack