Jump to content
  • Checkout
  • Login
  • Get in touch

osCommerce

The e-commerce.

Easy Populate bulk upload issues


Guest

Recommended Posts

Hi,

 

Up until recently, have had less that 300 products on the site, and have been dredding the moment of going into the split file route.

 

Now have a circa 4000 product catalogue ive been trying for days to upload, with no joy. :(

 

Ive uploaded and split the files, then loaded the split files, and it refuses to show more than about 600 products in the store, and whats worse they are all mixed up now regarding descriptions and product name.

 

PLEASE can someone who knows why i cant get what appears to be a simple upload when split in the Easy Populate manual to work, I would be most grateful as its driving me nuts!!lol

 

Cheers

 

Rick

Link to comment
Share on other sites

  • 4 weeks later...
If you have problems why not create a few smaller .csv files and upload one at a time?

Nic

 

Thanks for the reply.

 

Ive tried this. used the EP to break up the download into smaller numbered chunks, then uploaded as it states, and yet im still stuck with the same limited ( ie under 300) product count.

 

Either im uploading these chunks wrong ( which i hope is the case), or something else is not working right, but no matter in sections or in one whole chunk, i cannot increase the product count over 300 :(

 

Please help!

Link to comment
Share on other sites

  • 2 months later...

Its been a good few months now, and have come back to see if a fresh look will help me sort this problem, but it doesnt :-(

 

 

I would be soo pleased if someone could give me a reason why I cant load more than a few hundred products. The site is now at about 600, but no matter how i load the CSV file, wether it be attempting to load from temp file in one go, or using EPopulates "split CSV" function and loading each smaller file from the temp directory, I am still stuck with the same few hundred products.

 

Is there a particular way the split files should be loaded up, or am i missing something really simple, becuase this has ground any development of our site to a standstill, and I am desperate to get it sorted ASAP :-)

 

PLEASE HELP! :-)

Link to comment
Share on other sites

Does anyone have any ideas?

 

Please, we really need to get this sorted, I cant find anything relating to problems with uploading big files using Easy Populate, and we are stuck without it :-(

Link to comment
Share on other sites

Thanks for the reply.

 

Not sure how to do what you said either to be honest, as im a OSC novice too.

 

Any other ideas as to if this may sort the problem, or how we can resolve this issue? There must be a OSC Wizard here that can guide us through what I suspect should be a simple solution?

 

Cheers

 

 

Rick

Link to comment
Share on other sites

actually, im now trying to upload 10k products, and get a response saying

 

File uploaded.

Temporary filename:

User filename: products.txt

Size: 0

##Can not open file for reading. Script will terminate.

 

wtffff

Link to comment
Share on other sites

I am by no means an expert however I also had problems with lots of products and found this solution to work.

 

I have about 2,000 products on my site and often have changes to make that can mean uploading a large csv file.

 

I have found that if you do it in very small chunks you should have no problems.

 

I generally upload model, name and the department in the first batch so that you dont end up putting products in the wrong places later on.

 

Then I upload model, description, price and tax class

 

Then I upload model, image and status.

 

Then I upload the model and attributes ( this is the tricky bit and I have many homemade cutomised .csv files for this purpose as if you have lots of different colours and sizes you will end up with to large a file for excel to use in easy populate).

 

As long as you always have the v_products_model column in every upload and then the correct information you are wanting to add you should never have any problems with products mixing.

 

Also use the .csv format the .txt file that you quoted in your last post sound like you are trying to upload products directly onto your db through your sql rather than using easy populate.

Link to comment
Share on other sites

No offence jigga1234, but I have to say that approach sounds rather convoluted and complicated!

 

I've been using Easy Populate as my sole means of uploading since my first foray into osC, and it's superb for uploading. (It is a shame if can't remove products as well though.)

 

A shop I am currently working on for someone has approx 3500 products at the moment in its test stage, and I upload, delete, and re-upload those 3500 products 3 or 4 times at day at the moment. My testing/tweaking is intensive! :)

 

Anyway, what I've found is the best approach is to manually split your .CSV files into around 250 items, as FIMBLE suggested. I don't "trust" EP to split them for me, as I don't have any control over what it's doing. It's much better to take anything you can't control out of the equation!

 

I currently have 25 .CSV files that I first upload to the temp folder via Dreamweaver/FTP, and then import them into the database from the EP module. I split my .CSV's into manageable product groups based alphabetically on manufacturer, so some of my files only contain about 100 files, but others contain 270~280 products. My largest file is 287k - my smallest is 12k!

 

Each .CSV contains ALL the information for each item... product name, model, price, HTML description, attributes, options etc., everything. Splitting them as jigga1234 suggests would make keeping track of the upload process a nightmare, but uploading them (even with 25 files - maybe 50 once I've finished and included all 5000 products!) is easy when they are simply in alphabetical blocks. For example, my files cover A~C (Aprilia~CCM), D~G (Ducati~Gilera), H (Harley Davidson), H1, H2 (Honda has 400+ products, so is in itself split), and so on. This means I can also delete a folder in Admin (Harley Davidson, for example) work on its corresponding .CSV, and then re-upload it and nothing else has been effected.

 

My advice is to keep the file size of each .CSV file below 300k, and keep the number of items to around 250 (or below if there are an awful lot of attributes for each item that jacks the file size up). Upload them all to the temp folder first so that they are already on the server, then import. It's simple, methodical, and appears to be pretty fool-proof, even for a numpty newbie like me! It only takes around 5~7 mins for me to import all 25 .CSV's.

 

Easy Populate really is a great contribution. Stick with it as once you suss it it can make life very simple.

 

I hope this helps, or at least encourages you to stick with it.

 

Andy.

Link to comment
Share on other sites

Archived

This topic is now archived and is closed to further replies.

×
×
  • Create New...