Google Entries in Access Logs

[Mark Russell]

Dare I start another Google thread? Anyway, I've printed and read in full the two recent Google threads (one was 12 pages, the other 36) and am still somewhat confused. I thought I'd try a different approach. Below are the entries from my access logs of all the google crawls in November. Can someone take a look and briefly explain what they see? If I'm not asking too much, can you also relate what you see to the suggested code changes in the aforementioned threads (html_output, allprods, etc)?

 

My placement at google is good. I have four primary keyword phrases for my site and I'm getting page 1 on two of them, page 2 on one and page ? on the other.

 

I deployed robots.txt on the 11th as can be seen by the entries.

 

Would it be valuable to start another forum topic for posting and analyzing of search engine entries in access logs?

 

Thanks,

 

Mark

 

crawler11.googlebot.com - - [01/Nov/2002:19:45:11 -0500] "GET /robots.txt HTTP/1.0" "-" 404 298

crawler11.googlebot.com - - [01/Nov/2002:19:45:11 -0500] "GET / HTTP/1.0" "-" 302 0

crawler11.googlebot.com - - [01/Nov/2002:19:45:12 -0500] "GET /catalog/default.php HTTP/1.0" "-" 200 18445

 

crawl4.googlebot.com - - [04/Nov/2002:15:43:46 -0500] "GET /robots.txt HTTP/1.0" "-" 404 298

crawl4.googlebot.com - - [04/Nov/2002:15:43:47 -0500] "GET / HTTP/1.0" "-" 302 0

crawl4.googlebot.com - - [04/Nov/2002:15:43:48 -0500] "GET /catalog/default.php HTTP/1.0" "-" 200 18445

cawl4.googlebot.com - - [04/Nov/2002:15:55:43 -0500] "GET /catalog/default.php?cPath=21 HTTP/1.0" "-" 200 19791

 

crawl3.googlebot.com - - [04/Nov/2002:16:00:24 -0500] "GET /catalog/default.php?cPath=22 HTTP/1.0" "-" 200 18758

 

crawl1.googlebot.com - - [04/Nov/2002:18:38:11 -0500] "GET /catalog/default.php?cPath=42 HTTP/1.0" "-" 200 19444

 

crawl4.googlebot.com - - [10/Nov/2002:22:39:02 -0500] "GET /robots.txt HTTP/1.0" "-" 404 298

 

crawl5.googlebot.com - - [11/Nov/2002:01:42:44 -0500] "GET /robots.txt HTTP/1.0" "-" 404 298

crawl5.googlebot.com - - [11/Nov/2002:01:42:49 -0500] "GET /catalog/default.php HTTP/1.0" "-" 200 17709

 

crawl9.googlebot.com - - [11/Nov/2002:02:42:51 -0500] "GET /robots.txt HTTP/1.0" "-" 404 298

crawl9.googlebot.com - - [11/Nov/2002:02:42:53 -0500] "GET / HTTP/1.0" "-" 302 0

crawl9.googlebot.com - - [11/Nov/2002:02:42:59 -0500] "GET /catalog/default.php HTTP/1.0" "-" 200 17709

 

crawler11.googlebot.com - - [11/Nov/2002:21:25:25 -0500] "GET /robots.txt HTTP/1.0" "-" 200 1803

crawler11.googlebot.com - - [11/Nov/2002:21:25:27 -0500] "GET / HTTP/1.0" "-" 302 0

crawler11.googlebot.com - - [11/Nov/2002:21:25:29 -0500] "GET /catalog/default.php HTTP/1.0" "-" 200 20262

 

crawler11.googlebot.com - - [13/Nov/2002:06:58:27 -0500] "GET /robots.txt HTTP/1.0" "-" 200 1803

crawler11.googlebot.com - - [13/Nov/2002:06:58:27 -0500] "GET / HTTP/1.0" "-" 302 0

crawler11.googlebot.com - - [13/Nov/2002:06:58:33 -0500] "GET /catalog/default.php HTTP/1.0" "-" 200 20076

[Ian]

No, please not another Google thread.

 

You may want to look at www.webmasterworld.com

 

they have a number of forums specifically for this, as well as a Google knowledgebase.

[dahammer2]

or try here

http://www.sitepointforums.com/forumdispla...?s=&forumid=177

 

a whole forum dedicated to google also

 

Post the question there, soem very knowledgeable people...

[Mark Russell]

Thanks for the pointers...

 

M