Can spiders (google specifically) see my entire site?

[cgutzmer]

I have been trying to figure this out for a while now.... Is there some way to verify that my site is set up properly for search engines to parse my entire site? It LOOKS like they are only able to index my home page of my shop but I dont really know how to tell for sure.

Thanks

Chris

[Jack_mcs]

There are many sites on the web that allow you view your site as a spider would. You can even setup FF to do that.

[cgutzmer]

Thanks Jack! What is FF? I am not familiar with that acronym. I am trying to find some of those sites now. It looks like my site item pages are not indexed for some reason.... now I need to figure out why.

Chris

[Jack_mcs]

FireFox.

[Hotclutch]

I have been trying to figure this out for a while now.... Is there some way to verify that my site is set up properly for search engines to parse my entire site? It LOOKS like they are only able to index my home page of my shop but I dont really know how to tell for sure.

Thanks

Chris

 

Hi

 

Are you referring to the site listed in your profile? I had a look, and it only seems to consist of about 5 pages total. All of them are indexed in google. Put this into Google

 

site:www.mysite.com (replace with your web address)

[germ]

You can't force a spider to index anything.

 

Using rhe meta tag telling them it's OK is a start.

 

The generic form is:

 

<meta name="robots" content="index,follow">

 

Even using that, they won't index the entire site after just one crawl.

 

But after enough crawls the entire site will get indexed.

[♥mdtaylorlrim]

Sitemaps in your robots.txt file will help. But of course, you don't want ALL of your site to be indexed anyway...