Guest Posted July 22, 2004 Posted July 22, 2004 HI, I have just went to http://www.webconfs.com/search-engine-spider-simulator.php and analyse my site www.kayukayuhome.com It turns out that only some of the products are being spidered. Is this means that my other products will not be indexed? How do i make the spider crawl all of my products therefore index all of the products? Thanks, Danny
Jack_mcs Posted July 23, 2004 Posted July 23, 2004 There is probably not a problem. Those simulators do not usually do deep scans. They are meant to just give you an idea of what a spider sees. As long as you don't have a directory or file blocked by your robots.txt file, the bots will eventually get to all of your pages. Jack Support Links: For Hire: Contact me for anything you need help with for your shop: upgrading, hosting, repairs, code written, etc. All of My Addons Get the latest versions of my addons Recommended SEO Addons
Recommended Posts
Archived
This topic is now archived and is closed to further replies.