herbsandhelpers Posted June 22, 2023 Posted June 22, 2023 For any products that get imported everything is good. However the process stops at 33% never moves on after this. See pic. I read that if you have a language not on V4 ( I have Chinese in V2) then it may not work? Don't know why this happens. I tried using csv but everything gets scrambled. Can someone assist please. All other areas imported good. Lorraine Quote
herbsandhelpers Posted June 23, 2023 Author Posted June 23, 2023 (edited) In what sense? You can see the number of products on the screen shot. In total 601 products get imported properly but no more. Edited June 23, 2023 by herbsandhelpers Quote
jimdanforth Posted June 23, 2023 Posted June 23, 2023 OK. I know with the update process there were memory issue and was curious if it was occuring because your database is huge. But that seems pretty reasonable. Quote
herbsandhelpers Posted June 24, 2023 Author Posted June 24, 2023 Thanks for that I recently did the ‘huge’ update to 4.12 and it went pretty quick. Hmmm so I still need to solve this problem or find another reliable way of importing all the products. Can someone advise please? Thank you, Lorraine Quote
stonehead Posted June 24, 2023 Posted June 24, 2023 Hi all, same here: importing from OSCOM CE Phoenix v1.0.5.0 to 4.12 and products (~3000) get stuck at around 30% and/or orders (~6500) at 49%. Quote
pandrei Posted June 24, 2023 Posted June 24, 2023 On 6/23/2023 at 1:01 AM, herbsandhelpers said: However the process stops at 33% never moves on after this. See pic. Could you send me the log files: 1) Common log files from Admin -> Settings -> Tools -> Error log viewer -> Download all logs 2) osCommerce link logs from lib/common/extensions/OscLink/logs/*.log Quote
stonehead Posted June 24, 2023 Posted June 24, 2023 lib/common/extensions/OscLink/logs/ Logs are just stopping without particular error codes, but backend/app.log shows: Position & date IP Level Category Error description 2023-06-24 19:01:04 93.82.16.52 error yii\base\ErrorException:1 yii\base\ErrorException: Allowed memory size of 268435456 bytes exhausted … 2023-06-24 19:01:04 93.82.16.52 error yii\base\ErrorException:1 yii\base\ErrorException: Allowed memory size of 268435456 bytes exhausted … Quote
stonehead Posted June 24, 2023 Posted June 24, 2023 yii\base\ErrorException: Allowed memory size of 268435456 bytes exhausted (tried to allocate 110592 bytes) in []/lib/common/classes/Images.php:83 Quote
pandrei Posted June 26, 2023 Posted June 26, 2023 On 6/24/2023 at 10:15 PM, stonehead said: lib/common/extensions/OscLink/logs/ Logs are just stopping without particular error codes, but backend/app.log shows: On 6/24/2023 at 10:17 PM, stonehead said: yii\base\ErrorException: Allowed memory size of 268435456 bytes exhausted (tried to allocate 110592 bytes) in []/lib/common/classes/Images.php:83 It seems you have a huge image on you old osCommerce site. Could you send me these logs: 1) Common log files from Admin -> Settings -> Tools -> Error log viewer -> Download all logs 2) osCommerce link logs from lib/common/extensions/OscLink/logs/*.log Quote
herbsandhelpers Posted June 26, 2023 Author Posted June 26, 2023 Okay Andrei says no errors in logs so I’m now pursuing the matter with my host to see if they can solve the matter. Quote
herbsandhelpers Posted June 27, 2023 Author Posted June 27, 2023 PARTIALLY SOLVED Okay my host said the following: It's possible the PHP memory limit was being exhausted on this occasion, as it was being limited to just 256M due to the site's .htaccess fie. I've modified this for you now and increased the memory limit to 1024M. I can now get 70% in! Before it stops. I’ve referred back to host again. Grateful thanks to Andrei in being able to establish that no errors from OSC side. Lorraine Quote
stonehead Posted June 27, 2023 Posted June 27, 2023 Am 26.6.2023 um 16:16 schrieb pandrei: It seems you have a huge image on you old osCommerce site. Could you send me these logs: 1) Common log files from Admin -> Settings -> Tools -> Error log viewer -> Download all logs 2) osCommerce link logs from lib/common/extensions/OscLink/logs/*.log Please find the logs as requested. The biggest images on my old osCommerce site are 2x 11 Mbyte files, most of the files are 50-200kbyte. The most interesting error messages I saw: 2023-06-27 19:44:36 [93.82.16.52][-][91c3947e72a7b77468e1200c1224b651][error][yii\base\ErrorException:1] yii\base\ErrorException: Allowed memory size of 268435456 bytes exhausted (tried to allocate 937984 bytes) in /var/www/vhosts/<redacted>/lib/common/classes/Images.php:1701 Row products(2901): supplier changed to default because inventory extension is not installed products(2901): add default image waschbag.jpg File removed: /var/www/vhosts/<redacted>/images/waschbag.jpg I hope that helps, Best regards, Georg log_2023-06-27_19-40-18.log app.log list.log Quote
pandrei Posted June 28, 2023 Posted June 28, 2023 14 hours ago, stonehead said: Please find the logs as requested. The biggest images on my old osCommerce site are 2x 11 Mbyte files, most of the files are 50-200kbyte. Thanks for the logs Georg. We will investigate where the memory leak happens. You can increase the memory_limit PHP option as suggested in these comments: https://www.oscommerce.com/forums/topic/499062-new-update-crashed/?do=findComment&comment=1832100 https://www.oscommerce.com/forums/topic/499062-new-update-crashed/?do=findComment&comment=1832130 Quote
stonehead Posted June 28, 2023 Posted June 28, 2023 vor 9 Minuten schrieb pandrei: Thanks for the logs Georg. We will investigate where the memory leak happens. You can increase the memory_limit PHP option as suggested in these comments: https://www.oscommerce.com/forums/topic/499062-new-update-crashed/?do=findComment&comment=1832100 https://www.oscommerce.com/forums/topic/499062-new-update-crashed/?do=findComment&comment=1832130 I have to say thank you, Andrei! I know changing the Memory Limit > 512M is not possible for my hoster. I will therefore rather wait for the memory leak fix as I suppose I would need 1024M to have all products imported. Are the "File removed: /var/www/vhosts/<redacted>/images/waschbag.jpg" entries of any concern? Quote
pandrei Posted June 28, 2023 Posted June 28, 2023 (edited) 18 minutes ago, stonehead said: Are the "File removed: /var/www/vhosts/<redacted>/images/waschbag.jpg" entries of any concern? No, it just a temporary downloaded file. 18 minutes ago, stonehead said: I know changing the Memory Limit > 512M is not possible for my hoster. I will therefore rather wait for the memory leak fix as I suppose I would need 1024M to have all products imported. Unfortunately, fixing memory leaks problem is not an easy task. Especially if it only happens on some hosts. 1. Could you send me a screenshot of the state of your GD library: 2. Could you provide ftp access to your site with the osCommerce v4 for testing purposes? Edited June 28, 2023 by pandrei Quote
stonehead Posted June 28, 2023 Posted June 28, 2023 vor 6 Minuten schrieb pandrei: No, it just a temporary downloaded file. Unfortunately, fixing memory leaks problem is not an easy task. Especially if it only happens on some hosts. 1. Could you send me a screenshot of the state of your GD library: 2. Could you provide ftp access to your site with the osCommerce v4 for testing purposes? I can imagine how hard chasing memory leaks can be, especially with php. I also saw complaints in the log about "inventory extension" missing and default supplier, maybe a branch of code not everybody is touching? My GD library FTP-Access would be my ultima ratio as the old shop is life in another directory. I hope you understand. I am willing to test based on your suggestions as good as I can. Quote
pandrei Posted June 28, 2023 Posted June 28, 2023 36 minutes ago, stonehead said: I also saw complaints in the log about "inventory extension" missing and default supplier, maybe a branch of code not everybody is touching? It's just information messages for import from internal osCommerce v3. 37 minutes ago, stonehead said: My GD library Thanks. 37 minutes ago, stonehead said: FTP-Access would be my ultima ratio as the old shop is life in another directory. I hope you understand. I am willing to test based on your suggestions as good as I can. I see. I will contact you if testing needs your help. stonehead 1 Quote
herbsandhelpers Posted July 6, 2023 Author Posted July 6, 2023 Okay this may be mostly solved: I deleted everything on the imports link screen, full clean. I made sure all categories/brands area fully empty. I corrected any issues in old OSC e.g. ensuring each product had a manufacturer set, removing null product records etc. I did the import in order as suggested, pausing to check each entry okay. Products went to 99% this is enough for me! I've set Automatic import to do more, but really I'm done at 99% Good enough. Lorraine Quote
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.
Note: Your post will require moderator approval before it will be visible.