Script Just Stops

[adultsm]

I am in the process of writing a contribution, which basically reads an external URL feed and processes the data and inputs into the database. The Process is repeated for multiple URL's.

 

The script is Initiated from the admin in the "use_function" field of the configuration table.

 

The script starts and processes the data correctly, but around 12000 records the script just stops. (no error messages)

 

I suspected that the script was timing out, but having used the set_time_limit (0); in the function and also in the admin/configuration.php the script still stops around 12000 records.

 

I have reordered the URLs so that the one it falls over on is read first and it passes through ok, but again falls over on about 12000 records.

 

Any ideas what could be causing this... or any solutions... or at least any code i code use to throw up a message so i know what exactly i am dealing with.

 

I removed, changed and edited the "error_reporting(E_ALL & ~E_NOTICE);" in admin/includes/application_top.php to see if anything would display the error. but nothing is displayed.

 

 

The Snippet of script is as below

 

$handle = fopen($feed_url , "r");

while (($data = fgetcsv($handle, 2000, ",")) !== FALSE) {

...// Insert to database

...

}

 

this process is repeated for different $feed_urls

[train25]

Hi Alex,

 

Has any additional progress been made on this mod? I am more then interested in this project. Please provide an update on the current status

[adultsm]

Hi Alex,

 

Has any additional progress been made on this mod? I am more then interested in this project. Please provide an update on the current status

 

no more progress has been made.... in relation to the above topic...

 

I am willing to share the mod, but as i say my script just stops.

 

There are also a few more function included (which at present do not work(but they are commented out));

 

It is set up to only extract product feed from AffiliateWindow.co.uk, but planned for more affiliate networks, if i can discover how, but not really much time to work on it.

 

Best Wishes

Alex