Jump to content
  • Checkout
  • Login
  • Get in touch

osCommerce

The e-commerce.

Can't get Google to spider my site - any help appreciated!


ziggy138

Recommended Posts

Posted

I've had my site up for probably two months. I have several links to it from other sites, I have Google ads on my page, and I have text - yet my site does not show up in google....anywhere. If I do a search for the domain, it comes up not found. The other day my wife submitted an XML site map to Google, but it still isn't showing and when she tried to have them spider it, it came up with an error.

 

Is there something within OSC that is blocking the spiders?

 

I typed my domain name plus the .com into about 10 different seach engines and non of them found my site. They found text on another on of my sites that link to the site in question. (There were only about 10 results total that contained the site address - many were from ebay where we had auctioned off gift certificates to our site. When we did this, we had a text link in the body of the listing that should have sent spiders our way.)

 

Any help is greatly appreciated.

Thanks

Josh

Posted

You probably have tried this but under Admin->Configuration->Sessions there is a true/false item to "Prevent Spider Sessions" and you'll want to make sure that is set to false.

 

You can also check your meta tags on index.php and product_info.php and add this:

<meta name="ROBOTS" content="index,follow">

<meta name="REVISIT-AFTER" content="7 days">

 

CP

Posted
You probably have tried this but under Admin->Configuration->Sessions there is a true/false item to "Prevent Spider Sessions" and you'll want to make sure that is set to false.

 

You can also check your meta tags on index.php and product_info.php and add this:

<meta name="ROBOTS" content="index,follow">

<meta name="REVISIT-AFTER" content="7 days">

 

CP

 

 

Should "Prevent Spider Sessions" be set to true? I assume spiders sould not get sessions?

 

Darren :)

Posted
I've had my site up for probably two months. I have several links to it from other sites, I have Google ads on my page, and I have text - yet my site does not show up in google....anywhere. If I do a search for the domain, it comes up not found. The other day my wife submitted an XML site map to Google, but it still isn't showing and when she tried to have them spider it, it came up with an error.

 

Is there something within OSC that is blocking the spiders?

 

I typed my domain name plus the .com into about 10 different seach engines and non of them found my site. They found text on another on of my sites that link to the site in question. (There were only about 10 results total that contained the site address - many were from ebay where we had auctioned off gift certificates to our site. When we did this, we had a text link in the body of the listing that should have sent spiders our way.)

 

Any help is greatly appreciated.

Thanks

Josh

 

First you want to keep the setting of "Prvent Spider Sessions" to FALSE

This is important, if the spider get session ID's it will index the session with ID which may cause people to get the same session ID with the link that the spiders take; which will cause a merging of sessions - you do NOT want this.

 

Additionally.

 

The META Tag

 

<meta name="ROBOTS" content="index,follow">

 

this does not ned to be added. Create (if you have not) a robot.txt and congifure it for informing the spider what and where to browse and not to browse

 

robot.txt should be in root directory and have the following contents

 

User-agent:*

Allow: /

 

 

 

 

<meta name="REVISIT-AFTER" content="7 days">

This isn't needed either.

 

See my recent post to someone else here

http://www.oscommerce.com/forums/index.php?sho...30entry825930

 

 

Creating a site map does not make google index you, it merely provides them a away to know where everythign is and help to ensure they find all the content on you site.

 

What is your URL?

My Contributions

 

Henry Smith

Posted

Henry, you say that "Prvent Spider Sessions" should be always set to FALSE... but then you contradict yourself in the next sentence when you explain why preventing the spider sessions is so important.

 

Correct me if i'm wrong, but it should always be set to TRUE?

 

IMHO osC does a bad job here, as it is a double negative if the user picks 'false.' FALSE is another way of saying 'no' so you are saying NO I don't want to PREVENT spiders from getting sessions, thus what you are saying is that you do want them to get sessions.

Posted
Henry, you say that "Prvent Spider Sessions" should be always set to FALSE... but then you contradict yourself in the next sentence when you explain why preventing the spider sessions is so important.

 

Correct me if i'm wrong, but it should always be set to TRUE?

 

IMHO osC does a bad job here, as it is a double negative if the user picks 'false.' FALSE is another way of saying 'no' so you are saying NO I don't want to PREVENT spiders from getting sessions, thus what you are saying is that you do want them to get sessions.

 

 

Sorry, I meant to "First! You don't want to keep the setting of "Prevent Spider Sessions" to FALSE.

 

osC is asking "Prevent Spider Session"

 

False = No I don't want to prevent it

True = Yes, please prevent Spider's from getting session id's

My Contributions

 

Henry Smith

Archived

This topic is now archived and is closed to further replies.

×
×
  • Create New...