spiders/crawlers/robots tests

[ptrinephi]

Hi,

 

Anyone knows how to test the efficiency of your web site for spiders/crawlers/robots?

 

Are there web sites/tools that will do this and provide a report so we can optimize our site?

 

Thanks,

[FalseDawn]

take your pick

 

http://www.google.com/search?biw=1003&hl=e...pider+simulator