Jump to content
  • Checkout
  • Login
  • Get in touch

osCommerce

The e-commerce.

No Index of a Category


Guest

Recommended Posts

I have come across something that I have never had to work with before. I have a single category that I DON'T want Search Engines to crawl. Anyone have any ideas on how to stop indexing of just one category ?

 

 

 

 

 

Chris

Link to comment
Share on other sites

Hi Sara,

 

I have been researching this and don't think it can be done in .htaccess and although I can add a Disallow to the robots.txt, this will only work if the crawler follows the rules. Rogue crawlers will still index the category. I have to ensure they do not index it at all.

 

 

 

Any other suggestions ?

 

 

 

Chris

Link to comment
Share on other sites

If it appears on a page that a spider sees it will get indexed.

 

You can add the attribute rel="nofollow" to an anchor to keep the (good) bots from following the link but there is nothing to stop them from indexing the link.

 

So that leads us to the ultimate conclusion: Don't let any bot "see" the link and it won't get indexed.

 

And how do you do that?

:unsure:

 

Simple. Only display the link to logged in visitors.

 

Bots don't create accounts and don't log in.

 

Probably not what you wanted to hear, but it's the simplest solution.

If I suggest you edit any file(s) make a backup first - I'm not perfect and neither are you.

 

"Given enough impetus a parallelogramatically shaped projectile can egress a circular orifice."

- Me -

 

"Headers already sent" - The definitive help

 

"Cannot redeclare ..." - How to find/fix it

 

SSL Implementation Help

 

Like this post? "Like" it again over there >

Link to comment
Share on other sites

Not perfect, but working for google atleast...

 

<META NAME="ROBOTS" CONTENT="NOINDEX">

 

or

 

<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
Link to comment
Share on other sites

google is going to index everything regardless of what you tell them to do, they might not publicly show it though. Same goes for other engines.

 

If you want to 100% make sure googles eyes never see a particular page, your only option is to do some blackhat cloacking.

Link to comment
Share on other sites

Not perfect, but working for google atleast...or

 

 

I want ALL but ONE category indexed. So the NO FOLLOW would not work.

 

 

 

Chris

Link to comment
Share on other sites

I want ALL but ONE category indexed. So the NO FOLLOW would not work.

 

 

 

Chris

 

 

It will work if you write code making it show only for that category. :thumbsup:

Link to comment
Share on other sites

Archived

This topic is now archived and is closed to further replies.

×
×
  • Create New...