driven22 Posted February 24, 2022 Share Posted February 24, 2022 For a long time, bots visiting the site would call cookie_usage. In such a way that customers also only saw the cookie_usage.php page instead of logging into the store or when trying to go further in the shopping cart. I blocked unnecessary bots and the problem actually disappeared. Are the following server logs (in this case, google bot) correct (should the bot run the following "functions"?). Why does the cookie_usage.php file every time bots enter and is this the correct operation of the store? Can it be blocked - without blocking the access of the google bot for indexing the page? - [24/Feb/2022:13:29:37 +0100] "GET /login.php?cookie_test=1 HTTP/1.1" 302 0 "-" "Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" waw1 - [24/Feb/2022:13:29:37 +0100] "GET /cookie_usage.php HTTP/1.1" 200 4037 "-" "Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" waw1 Maybe it's a stupid question, but I had a huge problem with it for a long time and I would like to be sure that such logs are OK Link to comment Share on other sites More sharing options...
Hotclutch Posted February 24, 2022 Share Posted February 24, 2022 Its normal for bots to be redirected to the cookie_usage.php, because they are not allowed sessions (set in Admin). If you do not want these entries filling up your logs and maybe want to save on your crawl budget then you can block bots from crawling these pages, in robots.txt 51 minutes ago, driven22 said: Can it be blocked - without blocking the access of the google bot for indexing the page? I don't follow what you mean by this. cookie_usage is not really a page that needs to be in the index. If you mean can it be blocked and still appear in the index, then probably yes, if its already there in the index. Link to comment Share on other sites More sharing options...
Jack_mcs Posted February 24, 2022 Share Posted February 24, 2022 @driven22You can turn off the force cookie option in admin->Configuration->Session and they won't be sent to that page. Support Links: For Hire: Contact me for anything you need help with for your shop: upgrading, hosting, repairs, code written, etc. All of My Addons Get the latest versions of my addons Recommended SEO Addons Link to comment Share on other sites More sharing options...
driven22 Posted February 25, 2022 Author Share Posted February 25, 2022 I have force cookie disabled in admin - but from time to time, the cookie_usage.php page appears (as if some file was running the force cookie option even though it is disabled in admin) or some other problem, but I cannot locate it. Until the cache on the server is cleared, no one can buy the products. Previously, I had so every 3-7 days. Now much less, but it happens and I don't have any purchases in the store then. Link to comment Share on other sites More sharing options...
Hotclutch Posted February 25, 2022 Share Posted February 25, 2022 If cookie_usage is already in the index, then googlebot and other bots will keep fetching the URL to try to keep its content up to date. This is regardless of the Admin setting. There's no file being run. You can block with robots.txt, this will stop the crawl requests. Or you can set meta noindex, which will drop the URL out of the index and cause the crawl frequency to drop. Link to comment Share on other sites More sharing options...
Jack_mcs Posted February 25, 2022 Share Posted February 25, 2022 7 hours ago, driven22 said: Until the cache on the server is cleared, no one can buy the products. Then something is broken in your shop. Customers have nothing to do with search engines. As long as the force cookie option is off the customers should not see that page. Try turning off the cache option to see if that helps. In the worst case you can add a redirect command in the cookie_usage.php file so that if it is called there's no blocking. Support Links: For Hire: Contact me for anything you need help with for your shop: upgrading, hosting, repairs, code written, etc. All of My Addons Get the latest versions of my addons Recommended SEO Addons Link to comment Share on other sites More sharing options...
driven22 Posted February 25, 2022 Author Share Posted February 25, 2022 I have already had 3 days of such problems with cookie_usage with customers. Cache disabled, force Cookie- disabled :( What to enter in the redirection so that the shop is not blocked. I lose customers .. :( Link to comment Share on other sites More sharing options...
Jack_mcs Posted February 25, 2022 Share Posted February 25, 2022 1 hour ago, driven22 said: What to enter in the redirection so that the shop is not blocked. In the cookie_usage.php file after the line that loads the application_top file add this line tep_redirect(tep_href_link('index.php')); Support Links: For Hire: Contact me for anything you need help with for your shop: upgrading, hosting, repairs, code written, etc. All of My Addons Get the latest versions of my addons Recommended SEO Addons Link to comment Share on other sites More sharing options...
driven22 Posted February 26, 2022 Author Share Posted February 26, 2022 Thank you for your help. Will it have a negative impact on indexing robots or reduce store security ( if cookie_usage will be redirect )? Link to comment Share on other sites More sharing options...
Jack_mcs Posted February 26, 2022 Share Posted February 26, 2022 On a properly working shop, no, the search engines won't be affected. They should not be going to that page. If they are always ending up on it for some reason then they will be redirected to the home page, which might be wrong. suggest you install my View Counter addon since it will show you the bots coming in and the pages they access. As for security, it won't affect that at all. Support Links: For Hire: Contact me for anything you need help with for your shop: upgrading, hosting, repairs, code written, etc. All of My Addons Get the latest versions of my addons Recommended SEO Addons Link to comment Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.