Really long parse times

[Jeynesey]

Hi guys.

 

I'm getting rediculously long parse times from time to time on my store.

 

Anyone got any ideas why? Is this a hosting issue or a scripting issue with the store?

 

The url is http://expressauto.co.uk/store/catalog/index.php

 

Thanks very much in advance to anyone who can help!

[boxtel]

Hi guys.

 

I'm getting rediculously long parse times from time to time on my store.

 

Anyone got any ideas why? Is this a hosting issue or a scripting issue with the store?

 

The url is http://expressauto.co.uk/store/catalog/index.php

 

Thanks very much in advance to anyone who can help!

 

category counts, 30K for thumbnails, you should know these things already.

[Avec]

You could speed your site load time by using a thumbnail contribution, but you specifically said long parse times. To reduce parse time, go through the thread below.

 

Store Speed Optimization

[Jeynesey]

category counts, 30K for thumbnails, you should know these things already.

oooooooooooooh, aren't you just marvelous.

 

you know, you didnt know how this worked at one point either, smart arse.

[Jeynesey]

You could speed your site load time by using a thumbnail contribution, but you specifically said long parse times. To reduce parse time, go through the thread below.

 

Store Speed Optimization

thanks very much, i will look into this thread.

 

the thing is, it sometimes takes only 2 seconds to load a page and then sometimes nearly a minute. i'm pretty sure that's not because i have too many thumbnails is it?

[Guest]

the thing is, it sometimes takes only 2 seconds to load a page and then sometimes nearly a minute. i'm pretty sure that's not because i have too many thumbnails is it?

 

 

I have the same thing going on, some times a couple of seconds to load a page, others over 10 or 15 seconds, bye bye customers, and I have one of the thumbnail contributions installed already.

 

ally

[Jeynesey]

so do you have any other ideas why we're getting this? :(

[Guest]

so do you have any other ideas why we're getting this? :(

 

 

There was one time a few months back I was quzzing the host about it as I was working on a site in the small hours of the morning and they admitted that it would be slower due to the servers being under increased load doing backups etc, I get it at all times of the day, another host claims its dns routing problems when I've seen sites going 404 for a few minutes.

 

Need something measurable so as if I change hosts I'm not locking myself in to another 12 months of trouble.

 

Currently doing this:

Check your error_log and enable logging (Admin > Configuration > Logging) to time the queries and page parse times.

 

 

Have also turned off the calculate categorie counts, just after doing a custom workaround for a rather different categories display and noticed a difference, wanting to get the times measured, will keep you appraised of how I get on.

Admin > Configuration > My Store > show category counts

 

 

Share any tips you find....

ally

[Guest]

the plot thickens, have just been testing my dev site:

http://test.newlifehealthcare.co.uk/health-concerns.php

 

Parse Time: 0.132s

 

but the page took about 5 seconds to appear!

 

Thumbnails plugin installed, show categories set to false

 

This is the output from the page_parse_time.log

07/12/2006 01:12:38 - /health-concerns.php (0.132s)
QUERY select value from sessions where sesskey = 'e0eb9ce71d8d5625f0e36253676f20ca' and expiry > '1165453959'
RESULT Resource id #19 
QUERY select code, title, symbol_left, symbol_right, decimal_point, thousands_point, decimal_places, value from currencies
RESULT Resource id #23 
QUERY DELETE FROM cache WHERE cache_expires <= '2006-12-07 01:12:39'
RESULT 1 
QUERY SELECT cache_expires FROM cache WHERE cache_id='9e18319fdade9c4245b75b9845486bb8' AND cache_language_id='1' LIMIT 1
RESULT Resource id #33 
QUERY SELECT cache_expires FROM cache WHERE cache_id='dae46d252d93631f218b79dd62eb04eb' AND cache_language_id='1' LIMIT 1
RESULT Resource id #36 
QUERY SELECT cache_expires FROM cache WHERE cache_id='f47315cba5e35ca49994fbf925cfaa75' AND cache_language_id='1' LIMIT 1
RESULT Resource id #39 
QUERY SELECT cache_id, cache_language_id, cache_name, cache_data, cache_global, cache_gzip, cache_method, cache_date, cache_expires FROM cache WHERE cache_language_id='1' AND cache_global='1'
RESULT Resource id #42 
QUERY delete from whos_online where time_last_click < '1165453059'
RESULT 1 
QUERY select count(*) as count from whos_online where session_id = 'e0eb9ce71d8d5625f0e36253676f20ca'
RESULT Resource id #48 
QUERY update whos_online set customer_id = '0', full_name = 'Guest', ip_address = '84.12.199.71', time_last_click = '1165453959', last_page_url = '/' where session_id = 'e0eb9ce71d8d5625f0e36253676f20ca'
RESULT 1 
QUERY select banners_id, date_scheduled from banners where date_scheduled != ''
RESULT Resource id #58 
QUERY select b.banners_id, b.expires_date, b.expires_impressions, sum(bh.banners_shown) as banners_shown from banners b, banners_history bh where b.status = '1' and b.banners_id = bh.banners_id group by b.banners_id
RESULT Resource id #61 
QUERY select specials_id from specials where status = '1' and now() >= expires_date and expires_date > 0
RESULT Resource id #65 
QUERY select cd.categories_name, c.category_head_title_tag, c.category_head_desc_tag, c.category_head_keywords_tag from categories c, categories_description cd where c.categories_id = '0' and cd.categories_id = '0' and cd.language_id = '1'
RESULT Resource id #75 
QUERY select manufacturers_name from manufacturers where manufacturers_id = '0'
RESULT Resource id #78 
QUERY select c.categories_id, cd.categories_name, c.parent_id from categories c, categories_description cd where c.parent_id = '0' and c.categories_id = cd.categories_id and cd.language_id='1' order by sort_order, cd.categories_name
RESULT Resource id #84 
QUERY select products_id, products_price, products_tax_class_id, products_weight from products where products_id = '39'
RESULT Resource id #89 
QUERY select sum(tax_rate) as tax_rate from tax_rates tr left join zones_to_geo_zones za on (tr.tax_zone_id = za.geo_zone_id) left join geo_zones tz on (tz.geo_zone_id = tr.tax_zone_id) where (za.zone_country_id is null or za.zone_country_id = '0' or za.zone_country_id = '222') and (za.zone_id is null or za.zone_id = '0' or za.zone_id = '0') and tr.tax_class_id = '0' group by tr.tax_priority
RESULT Resource id #92 
QUERY select specials_new_products_price from specials where products_id = '39' and status = '1'
RESULT Resource id #95 
QUERY SELECT count( * ) AS total FROM products_to_categories p2c left join products p on p2c.products_id = p.products_id WHERE p2c.categories_id = '50' and p.products_status = '1'
RESULT Resource id #98 
QUERY SELECT count( * ) AS total FROM products_to_categories p2c left join products p on p2c.products_id = p.products_id WHERE p2c.categories_id = '31' and p.products_status = '1'
RESULT Resource id #101 
QUERY SELECT count( * ) AS total FROM products_to_categories p2c left join products p on p2c.products_id = p.products_id WHERE p2c.categories_id = '25' and p.products_status = '1'
RESULT Resource id #104 
QUERY SELECT count( * ) AS total FROM products_to_categories p2c left join products p on p2c.products_id = p.products_id WHERE p2c.categories_id = '29' and p.products_status = '1'
RESULT Resource id #107 
QUERY select count(*) as total from sessions where sesskey = 'e0eb9ce71d8d5625f0e36253676f20ca'
RESULT Resource id #111 
QUERY update sessions set expiry = '1165455399', value = 'cart|O:12:\"shoppingcart\":5:{s:8:\"contents\";a:1:{i:39;a:1:{s:3:\"qty\";i:1;}}s:5:\"total\";d:8.230000000000000426325641456060111522674560546875;s:6:\"weight\";d:0;s:6:\"cartID\";s:5:\"45577\";s:12:\"content_type\";b:0;}language|s:7:\"english\";languages_id|s:1:\"1\";currency|s:0:\"\";navigation|O:17:\"navigationhistory\":2:{s:4:\"path\";a:1:{i:0;a:4:{s:4:\"page\";s:9:\"index.php\";s:4:\"mode\";s:6:\"NONSSL\";s:3:\"get\";a:0:{}s:4:\"post\";a:0:{}}}s:8:\"snapshot\";a:0:{}}new_products_id_in_cart|s:2:\"39\";' where sesskey = 'e0eb9ce71d8d5625f0e36253676f20ca'
RESULT 1 
07/12/2006 01:12:39 - / (0.055s)

 

Any thoughts on how I isolate where the bottle neck is occuring?

Why it loads in milli seconds some times and seconds other times for the same page?

Nb. Even though above the parse time showed 0.132s the page did not display fully for about 5 seconds

 

Ally

[Guest]

The parse times, just show the time it has taken to access and get all the information from the database, it does not incorporate image loading etc.

[Guest]

The parse times, just show the time it has taken to access and get all the information from the database, it does not incorporate image loading etc.

 

 

about 770-80% of the time all pages load in < 2 seconds, which is why I dont know how to isolate the fault, if it was page/pic size I would think it would take longer consistently, not 2 seconds some times and 20 seconds when it is really bad!

 

Not the fondest of intermitent faults :(

ally

[Guest]

so do you have any other ideas why we're getting this? :(

 

This page talks about http pipelining and I'm pretty sure I'll be getting round to using it in the next couple of weeks as I think this is the main problem I am seeing where it can take 5+ seconds for a little image to download and I have noticed the problem occurs more in IE.

http://www.die.net/musings/page_load_time/

 

I think the next main thing for me to do will be to switch hosting plans on to VPS for hosting, a Virtual Private Server where my allocated disk space is partitioned and that means that my site(s) shouldnt be affected by other sites on the same shared server being under heavy load or if the server is being backed up. The hosts have confirmed that things slow down when the server is being backed up and if other sites are under heavy load.

As well as not having disk space issues, being able to turn on the query cache should be a great help as well as a few other tips.

http://www.oscommerce.com/community/contributions,1484

 

Came across this for firefox, is a great little bit for seeing what part of the page the problem is on in that is shows you which parts of the page, css, images, js etc took how long to download:

https://addons.mozilla.org/firefox/1843/

I've not got in to playing with any of these as the firebug tool pretty much gave me what I want, stress testing tools:

http://www.softwareqatest.com/qatweb1.html

 

 

Also going to change the product thubnailer that I use, apparently it creates the thumbnail every time it is requested, have had a better one pointed out to me that does this only once until it is deleted.

http://www.oscommerce.com/community/contributions,1484

 

This is a good tool to see if your site is live using a different isp, currently I've seen problems thinking a site was off line and the hosts refered me to this saying I had a dns problem.

http://www.the-cloak.com/login.html

 

Am beginning to look at doing this also, have just read through again and noticed that although I had removed the code for banners in the footer a couple of years ago I didnt know there was something in application_top not needed:

http://www.oscommerce.com/forums/index.php?showtopic=119077

 

I have also switched off category counts and noticed a difference.

Seen a big difference the other night when I started deleting a lot of unused code in index.php for displaying manufacturers and sub categories. Have also decided to put the code for application bottom inside footer.php, hence reducing the need to call another file every time a page is clicked, every little helps.

 

So with some of the above in place I see a big improvement in my site, not enough that page loading issues arent still there but certainly enough listed above to get things zipping along a bit faster.

 

Hope that Helps and please share anything that you have found that helps speed things up,

Ally

[Brooke]

this may be of interest to you http://www.oscommerce.com/forums/index.php?showtopic=208494

even if you turn the category counts off in the admin, it still runs. i havent gone through and deleted the code yet, but im seriously thinking about it.

also, could your differences in parse times be due to current traffic at your site? quicker when its just you there vs if you have a lot of people browsing the store.