Jump to content
  • Checkout
  • Login
  • Get in touch

osCommerce

The e-commerce.

New Google Sitemap Generator


ckyshop.co.uk

Recommended Posts

  • Replies 54
  • Created
  • Last Reply

Top Posters In This Topic

I installed Google Sitemap Generator yesterday and all is OK so far.

However it can be enhanced, a third sitemap showing manufacturers,

I've already written one and have it installed.To help with search enging optimization the url's generated could have some

meaningful text added such as &title=product%20name

 

..that sounds good :thumbsup: - can you post the manufacturer sitemap php? :rolleyes:

 

br

stefan

Link to comment
Share on other sites

I have an earlier post here dated Feb 13, 2008. I did install Google Sitemap Generator a few days ago. I have through this thread and many others.

 

Ok, I have done a few changes to both robots.txt and sitemap.xml files:

 

Here is my robots.txt file:

User-agent: Googlebot-Image
Disallow: /

User-agent: *
Allow: /googleSitemapCategories.php
Allow: /googleSitemapProducts.php
Allow: /sitemap.xml

User-agent: *
Disallow: /admin
Disallow: /account.php
Disallow: /advanced_search.php
Disallow: /checkout_shipping.php
Disallow: /cookie_usage.php
Disallow: /create_account.php
Disallow: /login.php
Disallow: /password_forgotten.php
Disallow: /popup_image.php
Disallow: /shopping_cart.php
Disallow: /images/
Disallow: /cgi-bin/
Disallow: /download/
Disallow: /product_reviews_write.php
Disallow: /validation_png.php
Disallow: /validation_png_2.5.php
Disallow: /popup_cvv.php
Disallow: /cvv_help.php
Disallow: /address_book.php
Disallow: /account_password.php

 

Here is a small section of my sitemap.xml file:

<?xml version="1.0" encoding="UTF-8" ?>
<urlset xmlns="http://www.google.com/schemas/sitemap/0.84" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://www.google.com/schemas/sitemap/0.84 [url="http://www.google.com/schemas/sitemap/0.84/sitemap.xsd">"]http://www.google.com/schemas/sitemap/0.84...p.xsd">[/url]
<url>
	<loc>http://brs-giftshop.com</loc>
	<lastmod>2008-03-04</lastmod>
	<changefreq>weekly</changefreq>
	<priority>0.5</priority>
</url>
<url>
	<loc>http://brs-giftshop.com/american-spirit-c-36.html</loc>
	<lastmod>2008-03-04</lastmod>
	<changefreq>weekly</changefreq>
	<priority>0.5</priority>
</url>
<url>
	<loc>http://brs-giftshop.com/safari-c-22_59.html</loc>
	<lastmod>2008-03-04</lastmod>
	<changefreq>weekly</changefreq>
	<priority>0.5</priority>
</url>
<url>
	<loc>http://brs-giftshop.com/shabby-elegance-c-22_68.html</loc>
	<lastmod>2008-03-04</lastmod>
	<changefreq>weekly</changefreq>
	<priority>0.5</priority>
</url>
<url>
	<loc>http://brs-giftshop.com/sophisticated-decor-c-22_53.html</loc>
	<lastmod>2008-03-04</lastmod>
	<changefreq>weekly</changefreq>
	<priority>0.5</priority>
</url>
<url>
	<loc>http://brs-giftshop.com/tropical-c-22_61.html</loc>
	<lastmod>2008-03-04</lastmod>
	<changefreq>weekly</changefreq>
	<priority>0.5</priority>
</url>
<url>
	<loc>http://brs-giftshop.com/victorian-c-22_63.html</loc>
	<lastmod>2008-03-04</lastmod>
	<changefreq>weekly</changefreq>
	<priority>0.5</priority>
</url>
<url>
	<loc>http://brs-giftshop.com/wall-decor-c-22_74.html</loc>
	<lastmod>2008-03-04</lastmod>
	<changefreq>weekly</changefreq>
	<priority>0.5</priority>
</url>
<url>
	<loc>http://brs-giftshop.com/birdhousesbirdfeeders-c-1_70.html</loc>
	<lastmod>2008-03-04</lastmod>
	<changefreq>weekly</changefreq>
	<priority>0.5</priority>
</url>
<url>
	<loc>http://brs-giftshop.com/windchimes-c-1_69.html</loc>
	<lastmod>2008-03-04</lastmod>
	<changefreq>weekly</changefreq>
	<priority>0.5</priority>
</url>
<url>
	<loc>http://brs-giftshop.com/links.php/lPath/7</loc>
	<lastmod>2008-03-04</lastmod>
	<changefreq>weekly</changefreq>
	<priority>0.5</priority>
</url>
<url>
	<loc>http://brs-giftshop.com/links_submit.php</loc>
	<lastmod>2008-03-04</lastmod>
	<changefreq>weekly</changefreq>
	<priority>0.5</priority>
</url>
<url>
	<loc>http://brs-giftshop.com/index.html</loc>
	<lastmod>2008-02-15</lastmod>
	<changefreq>weekly</changefreq>
	<priority>0.5</priority>
</url>
<url>
	<loc>http://brs-giftshop.com/info_shopping_cart.php</loc>
	<lastmod>2008-03-04</lastmod>
	<changefreq>weekly</changefreq>
	<priority>0.5</priority>
</url>
<url>
	<loc>http://brs-giftshop.com/sitemap.php</loc>
	<lastmod>2008-03-04</lastmod>
	<changefreq>weekly</changefreq>
	<priority>0.5</priority>
</url>
<url>
	<loc>http://brs-giftshop.com/orderform.html</loc>
	<lastmod>2008-02-20</lastmod>
	<changefreq>weekly</changefreq>
	<priority>0.5</priority>
</url>
</urlset>

 

After installing Google Sitemap Generator, I did go to google. In drop-down box, I selected general and then typed googleSitemapProducts.php and submitted. Then did the same for Categories. For both entries, I receive an error. The details reports this:

 

URL restricted by robots.txt

We encountered an error while trying to access your Sitemap. Please ensure your Sitemap follows our guidelines and can be accessed at the location you provided and then resubmit.

 

Now If we have google sitemap generator installed, do we still need sitemap.xml?

 

Here is location of my files:

domain_name.com/robots.txt

domain_name.com/sitemap.xml

doamin_name.com/googleSitemapCategories.php

domain_name.com/googleSitemapProducts.php

 

I have even left a message google webmasters tools forum. Still no reply. Even am trying to leave a message with google webmaster, but each link keeps taking me places, but not where I need to leave a message.

 

Sure hope someone has some ideas for me.

 

Thanks in advance.

 

bennett

Link to comment
Share on other sites

  • 3 weeks later...

i just installed this contrib and add both scripts to google webmaster tools as "General Web Sitemap". I get the following errors:

 

"Unsupported file format Your Sitemap does not appear to be in a supported format. Please ensure it meets our Sitemap guidelines and resubmit."

 

I'm listing them individually as:

 

http://www.mysite.com/googleSitemapCategories.php

http://www.crfsonly.com/googleSitemapProducts.php

 

again, both as "General Web Sitemap". Any suggestions as to why this is not working? thanks for any help.

Link to comment
Share on other sites

  • 3 weeks later...

Hello from Germany,

 

I use this contrib, too. (with Seo URLs) It works fine, but...

 

I want that the file creates sitemaps for german and for the english articlenames.

 

So the quantity of the links should double.

 

Can someone help me with my problem? The language_id must included. But how?

 

Thank you and sorry for my bad english.

 

Best regards

Link to comment
Share on other sites

  • 3 weeks later...
Hello from Germany,

 

I use this contrib, too. (with Seo URLs) It works fine, but...

 

I want that the file creates sitemaps for german and for the english articlenames.

 

So the quantity of the links should double.

 

Can someone help me with my problem? The language_id must included. But how?

 

Thank you and sorry for my bad english.

 

Best regards

 

 

same here.

i gues an alternative sitemap generator would be better.

i used external programs and the hassle is indeed regenerating a new one every other week.

external services i wont use.

 

anyone know a good one that uses languages ?

Link to comment
Share on other sites

  • 4 months later...

I am getting the following error in Google for googleSitemapProducts.php

 

All the URLs in your Sitemap have the same priority.

All the URLs in your Sitemap are set to the same priority (not the default priority). Priority indicates the importance of a particular URL relative to other URLs on your site, and doesn't impact your site's performance in search results. If all URLs have the same priority, Google can't tell which are more important. Help

 

How do I fix this :blink:

Link to comment
Share on other sites

  • 3 weeks later...
  • 3 weeks later...

Hi,

 

Please help!

 

I run the first file and getthe error below. whats wrong? I'm using ultimate SEO's and Rc2 with no other adons.

 

Internal Server Error

The server encountered an internal error or misconfiguration and was unable to complete your request.

 

Please contact the server administrator, [email protected] and inform them of the time the error occurred, and anything you might have done that may have caused the error.

 

More information about this error may be available in the server error log.

Link to comment
Share on other sites

  • 3 weeks later...

I'm getting this error:

 

All the URLs in your Sitemap have the same priority.

All the URLs in your Sitemap are set to the same priority (not the default priority). Priority indicates the importance of a particular URL relative to other URLs on your site, and doesn't impact your site's performance in search results. If all URLs have the same priority, Google can't tell which are more important. Help Problem detected on:

 

Any ideas how to sort this one?

Link to comment
Share on other sites

I'm getting this error:

 

All the URLs in your Sitemap have the same priority.

All the URLs in your Sitemap are set to the same priority (not the default priority). Priority indicates the importance of a particular URL relative to other URLs on your site, and doesn't impact your site's performance in search results. If all URLs have the same priority, Google can't tell which are more important. Help Problem detected on:

 

Any ideas how to sort this one?

 

I am new at posting here but here it goes...

 

I fixed the Priority problem :)

 

Open and Edit GoogleSitemapManufacturers.php

 

Find

$content .= "\t\t" . '<lastmod>'.trim($data['lastmod']).'</lastmod>' . "\n";

$content .= "\t\t" . '<changefreq>'.trim($data['changefreq']).'</changefreq>' . "\n";

 

Add after Line

if (trim($data['priority']) == '') {

 

} else {

$content .= "\t\t" . '<priority>'.trim($data['priority']).'</priority>' . "\n";

}

 

Find:

/*

* Initialize the variable containers

*/

$container = array();

 

Add after Line:

$pricount = 0;

$arrayPriority = array();

 

 

 

Find:

$changefreq = 'weekly';

$priority = max( number_format($_total/$total, 1, '.', ','), .1);

 

Add After Line:

if (array_search(strval($priority), $arrayPriority)) {

$priority = '';

} else {

$pricount = $pricount + 1;

$arrayPriority[$pricount] = strval($priority);

}

 

 

Now you can do the same thing with GoogleSitemapProducts.php same steps and GoogleSitemapCategories.php

 

Thank you

 

Hope this helps

Edited by jer001
Link to comment
Share on other sites

I am new at posting here but here it goes...

 

I fixed the Priority problem :)

 

Open and Edit GoogleSitemapManufacturers.php

 

Find

$content .= "\t\t" . '<lastmod>'.trim($data['lastmod']).'</lastmod>' . "\n";

$content .= "\t\t" . '<changefreq>'.trim($data['changefreq']).'</changefreq>' . "\n";

 

Add after Line

if (trim($data['priority']) == '') {

 

} else {

$content .= "\t\t" . '<priority>'.trim($data['priority']).'</priority>' . "\n";

}

 

Find:

/*

* Initialize the variable containers

*/

$container = array();

 

Add after Line:

$pricount = 0;

$arrayPriority = array();

 

 

 

Find:

$changefreq = 'weekly';

$priority = max( number_format($_total/$total, 1, '.', ','), .1);

 

Add After Line:

if (array_search(strval($priority), $arrayPriority)) {

$priority = '';

} else {

$pricount = $pricount + 1;

$arrayPriority[$pricount] = strval($priority);

}

 

 

Now you can do the same thing with GoogleSitemapProducts.php same steps and GoogleSitemapCategories.php

 

Thank you

 

Hope this helps

 

Mine seems to be different. I don't the parts your talking about anywhere? Hmm

Link to comment
Share on other sites

  • 2 weeks later...
  • 4 weeks later...

Have installed this and all seems to be working fine. I did check in Google yesterday, and see that i have a warning which i have posted below.

 

All the URLs in your Sitemap have the same priority.

All the URLs in your Sitemap are set to the same priority (not the default priority). Priority indicates the importance of a particular URL relative to other URLs on your site, and doesn't impact your site's performance in search results. If all URLs have the same priority, Google can't tell which are more important.

 

Is this worth worrying about as i only have the one manufacturer at the moment.

REMEMBER BACKUP, BACKUP AND BACKUP

Link to comment
Share on other sites

  • 2 weeks later...

I find it interesting that the urls are coming back as standard osc urls, not seo friendly or ultimate seo urls.

 

Any reason?

 

 

Also, after submitting all 4 files (the reviews version also, I have some google errors being returned.

In the case of the reviews, the priority tags are flagged, I suspect due to such a high priority value.

 

In the manufacturers version is suspect it is because I have zero manufacturers in the catalog, and a near ly empty file is returned causing the bot to see it as improperly formatted.

 

I will add a if/else statement to account for empty returns to resolve that condition and update the zips when I have a few extra minutes.

Link to comment
Share on other sites

I have just submitted the googleSitemaps for Categories, Products and Reviews.

 

The Categories and Products ones seemed to work ok but Google told me I had several invalid tags.

 

The reviews one installed is the one dated 18 dec 2008.

 

When I run it in my browser it generates links like <loc>http://fundigital.co.uk/-pri-74.html?reviews_id=5</loc>

 

which would seem to indicate that it is not compatible with the ultimate SEO URLS which is also installed.

 

How do I fix it please.

 

Tks in advance

 

KdB

Link to comment
Share on other sites

....I have some google errors being returned....

In the case of the reviews, the priority tags are flagged, I suspect due to such a high priority value.

Well the formula used for reviews is way off base, acceptable priority values are only between 0.1 and 1.0.

We have only 20 reviews on 180 products, with ratios of 36.x being common using the formula in place.

 

I am working on a better method, but have to determine why I am getting some php errors when I have a little extra time to tweak.

The formula does provide derivatives range of 0-1.0, but 0 needs to be replaced.

The if else should take cre of that once I determine where the error in the statements is occuring.

Link to comment
Share on other sites

Well the formula used for reviews is way off base, acceptable priority values are only between 0.1 and 1.0.

We have only 20 reviews on 180 products, with ratios of 36.x being common using the formula in place.

 

I am working on a better method, but have to determine why I am getting some php errors when I have a little extra time to tweak.

The formula does provide derivatives range of 0-1.0, but 0 needs to be replaced.

The if else should take cre of that once I determine where the error in the statements is occuring.

 

I know - what I have managed to do is rewrite it completely - basically I went back to the Products one which actually worked and started from there. Then in the SQL query I only had one query and selected review id, products id, date added, last modified and review rating and restricted it to those with approved = 1 as I have the approvals mod in place which interestingly doesn't put a date in the last modified field.

 

then, as I figured it was more important to index positive reviews I calculated the ratio by dividing the reviews rating by 5 (the top rating value). At least that has given me some valid priority tags.

 

The version I downloaded also used the products_id in the max statement which I didn't understand the reason for and I couldn't work out how to convert datetime fields to an integer so it would calculate things properly (my PHP is a bit primitive).

 

Also SEO_URLs was defined as false which gave me a problem with valid location tags as I have Ultimate SEO URls in place.

 

As an additional enhancement, I have also put a button link to product_info on each of reviews pages so that if a review actually gets indexed someone can click through directly to the product.

 

Here is my code for googleSitemapReviews.php below

 

If you want to check the site it is at www.fundigital.co.uk (it is still in test mode)

 

Cheers -

 

KdB

 

 

<?php
/**
 * Google Sitemap Generator
 * 
 * Script to generate a Google sitemap for osCommerce based stores
 *
 * @license [url="http://opensource.org/licenses/gpl-license.php"]http://opensource.org/licenses/gpl-license.php[/url] GNU Public License
 * @version 1.2
 * @link [url="http://www.oscommerce-freelancers.com/"]http://www.oscommerce-freelancers.com/[/url] osCommerce-Freelancers
 * @copyright Copyright 2006, Bobby Easland 
 * @author Bobby Easland 
 * @filesource
 */

/*
 * Include the application_top.php script
 */
include_once('includes/application_top.php');

/*
 * Send the XML content header
 */
header('Content-Type: text/xml');

/*
 * Echo the XML out tag
 */
echo '<?xml version="1.0" encoding="UTF-8"?>' . "\n";
?>
<urlset xmlns="http://www.google.com/schemas/sitemap/0.84">
<?php

/*
 * Define the uniform node function 
 */
function GenerateNode($data){
	$content = '';
	$content .= "\t" . '<url>' . "\n";
	$content .= "\t\t" . '<loc>'.trim($data['loc']).'</loc>' . "\n";
	$content .= "\t\t" . '<lastmod>'.trim($data['lastmod']).'</lastmod>' . "\n";
	$content .= "\t\t" . '<changefreq>'.trim($data['changefreq']).'</changefreq>' . "\n";
	$content .= "\t\t" . '<priority>'.trim($data['priority']).'</priority>' . "\n";
	$content .= "\t" . '</url>' . "\n";
	return $content;
} # end function

/*
 * Define the SQL for the products query 
 */
$sql = "SELECT reviews_id as rID, 
							 date_added as date_added, 
							 last_modified as last_mod, 
							 products_id as pID,
							 reviews_rating  
				FROM " . TABLE_REVIEWS . " 
				WHERE approved = '1' 
				ORDER BY reviews_rating ";

/*
 * Execute the query
 */
$query = tep_db_query($sql);

/*
 * If there are returned rows...
 * Basic sanity check 
 */
if ( tep_db_num_rows($query) > 0 ){

	/*
	 * Initialize the variable containers
	 */
	$container = array();
	$number = 0;
	$top_rating = 5;

	/*
	 * Loop the query result set
	 */
	while( $result = tep_db_fetch_array($query) ){
		//$top = max($top, $result['reviews_rating	']);
		$location = tep_href_link(FILENAME_PRODUCT_REVIEWS_INFO, 'products_id=' . $result['pID'] . '&'. 'reviews_id=' . $result['rID'], 'NONSSL', false);
//			$location = tep_href_link(FILENAME_PRODUCT_INFO, 'products_id=' . $result['pID'], 'NONSSL', false);
		if ( tep_not_null($result['last_mod']) ){
			$lastmod = $result['last_mod'];
		} else {
			$lastmod = $result['date_added'];
		}
		$changefreq = 'weekly';
		$ratio = ($top_rating > 0) ? ($result['reviews_rating']/$top_rating) : 0;
		$priority = $ratio < .1 ? .1 : number_format($ratio, 1, '.', ''); 

		/*
		 * Initialize the content container array
		 */
		$container = array('loc' => htmlspecialchars(utf8_encode($location)),
							 				 'lastmod' => date ("Y-m-d", strtotime($lastmod)),
							 				 'changefreq' => $changefreq,
							 				 'priority' => $priority
											);

		/*
		 * Echo the generated node
		 */
		echo generateNode($container);
	} # end while
} # end if

/*
 * Close the urlset
 */
echo '</urlset>';

/*
 * Include the application_bottom.php script 
 */
include_once('includes/application_bottom.php');
?>

Link to comment
Share on other sites

  • 4 weeks later...
hi

how can I Install this mod in STS Template ؟

Thanks

 

I'm sorry but I can't help you there - I am not even sure what STS Template is as I have only been working with Oscommerce for a couple of months.

 

Maybe someone else can be of more help.

 

Regards

 

KdB

Link to comment
Share on other sites

  • 3 weeks later...
LOL, just worked it out.

 

I had changed a categories name without reseting the URL cache, hence too many redirects as the page being redirected to was then redirecting to the new category name :)

 

So hopefully this will fix it up

 

I got same problem: As I am using the SEO URL contribution , When i used googlesitemap contribution it worked fien but

Google says

 

URLs not followed

When we tested a sample of URLs from your Sitemap, we found that some URLs redirect to other locations. We recommend that your Sitemap contain URLs that point to the final destination (the redirect target) instead of redirecting to another URL

 

HTTP Error:

URL:

URL:

URL:

URL:

URL:

Problem detected on: 301 (Moved permanently) Help

http://pammarug.com/index.php?cPath=36

http://pammarug.com/index.php?cPath=35

http://pammarug.com/index.php?cPath=50

http://pammarug.com/index.php?cPath=24

http://pammarug.com/index.php?cPath=28

Feb 12, 2009

 

As due to SEO contribution ,my urls are shown as follows

 

http://pammarug.com/wilton-arti-c-1_44.html

 

can someone guide me how to sort it out.

Link to comment
Share on other sites

I got same problem: As I am using the SEO URL contribution , When i used googlesitemap contribution it worked fien but

Google says

 

URLs not followed

When we tested a sample of URLs from your Sitemap, we found that some URLs redirect to other locations. We recommend that your Sitemap contain URLs that point to the final destination (the redirect target) instead of redirecting to another URL

 

HTTP Error:

URL:

URL:

URL:

URL:

URL:

Problem detected on: 301 (Moved permanently) Help

http://pammarug.com/index.php?cPath=36

http://pammarug.com/index.php?cPath=35

http://pammarug.com/index.php?cPath=50

http://pammarug.com/index.php?cPath=24

http://pammarug.com/index.php?cPath=28

Feb 12, 2009

 

As due to SEO contribution ,my urls are shown as follows

 

http://pammarug.com/wilton-arti-c-1_44.html

 

can someone guide me how to sort it out.

 

Did anyone find a solution to this?

 

G

Need help installing add ons/contributions, cleaning a hacked site or a bespoke development, check my profile

 

Virus Threat Scanner

My Contributions

Basic install answers.

Click here for Contributions / Add Ons.

UK your site.

Site Move.

Basic design info.

 

For links mentioned in old answers that are no longer here follow this link Useful Threads.

 

If this post was useful, click the Like This button over there ======>>>>>.

Link to comment
Share on other sites

how does the prioity thing work, tried to apply what was said about updating the products file similar to the manufacturers but this got rid of the priorities altogether.

 

 

Can someone advise of the correct coded files????

 

Thanks

Getting better with mods but no programmer am I.

Link to comment
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Unfortunately, your content contains terms that we do not allow. Please edit your content to remove the highlighted words below.
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

×
×
  • Create New...