Easy Populate MAX?

[blueline]

Does anyone know how many products EP 2.71-MS2 supports?

 

Thanks,

-Chris

[Mark Evans]

Hi Chris

 

What problem are you having.... I am guessing it is timing out during the import?

[blueline]

Exactly. I really want to do 100,000 products, but I can do 50,000 increments easily enough.

 

It's timing out, but the weird thing is that it doesn't create ANY split files.

I figured at least a couple would be created before it timed out.

 

Thanks for helping,

[Mark Evans]

Have you tied splitting files at 1000 products to see if that works?

[Mark Evans]

I have just taken a look at the 2.72 version and I see this

 

set_time_limit(330); // VJ changed

 

Try setting that to

 

set_time_limit(0);

 

To see if that helps

[blueline]

I actaully set it to 1000 before posting. I will try setting the time limit to 0, and post the results in just a minute.

 

Thanks.

[blueline]

Still timed out, and still no split files.

[Mark Evans]

Is it actually timing out or running out of memory?

[blueline]

Well, I've got a gig and a half of the most expensive memory I could find from Kingston, and so I'm pretty sure it's not having a problem there.....but still, I suppose it is a possibility.

 

What's happening is it's showing progress in the toolbar as though it's doing something, and after about 5+ minutes, it goes to a "Page not Found".

Edited March 25, 2004 by blueline

[Mark Evans]

Ok thats a webserver timeout issue :) I think there is a setting you can choose for apache to lengthen that.

[blueline]

I'm running locally on IIS 5.1 - just a test server.

Edited March 26, 2004 by blueline

[Mark Evans]

There should be a timeout setting for IIS as well. Its set to 300 seconds on most servers.

 

See if you can find it... If not install apache ;)

 

There is the option in httpd.conf

 

#

# Timeout: The number of seconds before receives and sends time out.

#

Timeout 300

[blueline]

Found it. Trying it again. Will post the results in just a minute.

Thanks.

[blueline]

Same thing, and I set the timeout rate on my server to 5,000 seconds.

[Mark Evans]

Did the server run any longer or was the timeout period the same i.e 5 mins

 

5000 means 84ish mins so I guess it didnt run for that long :)

 

You might need to restart IIS for the setting to take effect

[blueline]

ell, even before that it was set to 900 (15 minutes) and it never actually ran that long. Can it be a php.ini setting?

[Mark Evans]

There is the following options available in php.ini

 

;;;;;;;;;;;;;;;;;;;

; Resource Limits ;

;;;;;;;;;;;;;;;;;;;

 

max_execution_time = 30 ; Maximum execution time of each script, in seconds

max_input_time = 60 ; Maximum amount of time each script may spend parsing request data

memory_limit = 8M ; Maximum amount of memory a script may consume (8MB)

[blueline]

Yep, just changed that....we'll see what happens.

[blueline]

Same results....but it seems as though the page ran longer this time.

[Mark Evans]

I guess its just a case of playing with the settings until you find one that works :(

 

I havent taken a look ae the EP script before... I will see if I can find time next week and maybe make some suggestions on improving the speed of it.

[blueline]

Sounds like a fun night for me.... :(

 

Thanks Mark. I appreciate your help.

[blueline]

Well, I tried using a file with only 5,000 products, and I'm still having the same problem.

[Mark Evans]

Have you considered adding a counter which increments to see how many records are processed before timing out?

[Guest]

try uploading using the split function, and then do each file after it is split by EP.

[blueline]

John, that is what I am trying to do.

 

Mark- If I use a counter, how am I to see the results if the server is timing out and going to a 404 error? I guess I could incrememnt the number in a DB....but that will add to processes being performed, and could add more strain to the server, which wouldn't give very accurate results.

 

Thanks.

-Chris