Jump to content
  • Checkout
  • Login
  • Get in touch

osCommerce

The e-commerce.

Errors in URLs restricted by robots.txt


pbpools

Recommended Posts

In my site map summary I am getting errors in URLs restricted by robots.txt? 1989 of my page are in this

error. I this happening to anyone else?

 

Here is a copy of my robot.txt:

User-agent: *

#Block out directories bots don't need to go to

Disallow: /customers/

Disallow: /demo/

Disallow: /download/

Disallow: /includes/

Disallow: /members/

Disallow: /pub/

Disallow: /temp/

Disallow: /account.php

Disallow: /account_edit.php

Disallow: /account_edit_process.php

Disallow: /account_history.php

Disallow: /account_history_info.php

Disallow: /account_newsletters.php

Disallow: /account_notifications.php

Disallow: /account_password.php

Disallow: /add_checkout_success.php

Disallow: /address_book.php

Disallow: /address_book_process.php

Disallow: /advanced_search.php

Disallow: /advanced_search_result.php

Disallow: /attributes_qty_prices_table_popup.php

Disallow: /checkout_confirmation.php

Disallow: /checkout_payment.php

Disallow: /checkout_payment_address.php

Disallow: /checkout_paypalipn.php

Disallow: /checkout_process.php

Disallow: /checkout_shipping.php

Disallow: /checkout_shipping_address.php

Disallow: /checkout_success.php

Disallow: /cookie_usage.php

Disallow: /create_account.php

Disallow: /create_account_process.php

Disallow: /create_account_success.php

Disallow: /download.php

Disallow: /login.php

Disallow: /logoff.php

Disallow: /password_forgotten.php

Disallow: /popup_coupon_help.php

Disallow: /popup_search_help.php

Disallow: /product_notifications.php

Disallow: /redirect.php

Disallow: /shipping_estimator_popup.php

Disallow: /tell_a_friend.php

Link to comment
Share on other sites

  • 4 weeks later...
This is one of the errors:

2-foot-round-winter-cover-p-903.html?action=buy_now&page...URL restricted by robots.txt

This is from my google site map.

 

I've had the same problem. Going on 5 months now without having google update thier indexs. I was wondering if the "buy_now" had something to do with the products not getting indexed by google.

Link to comment
Share on other sites

Archived

This topic is now archived and is closed to further replies.

×
×
  • Create New...