dahui Posted November 2, 2005 Posted November 2, 2005 Hello community I do habe a question on google page rank. The google bot is frequently comming to my site and I am well indexed in google msn yahoo ... I do have a robots txt and follow/monitor all activities with the phpstats monitor therefore I can clearly see which robot came when and where it went with full path a.s.o. The robots txt says e.g. User-agent: * ... Disallow: /phpstats ... the robot never was on any page in phpstats folder but http://mydomain.tld/phpstats/admin.php has a page rank of 3 (!) whilest all my other sites that are crawled by googlebot have either 1 or 0 or n/a ??? any ideas whats going on ???
Guest Posted November 3, 2005 Posted November 3, 2005 Hi Mike, all it takes is someone to place a reciprocal to one of the "restricted" pages (can figure it out by browsing your robots.txt file). Spiders blindly will get it. I've seen google cacheing even https pages. The more info the better isn't it? :lol: Hard to say, Another way to avoid this problem will be to hide links when the $spider_flag variable is set and return a 404 error if they ever try to access it.
dahui Posted November 3, 2005 Author Posted November 3, 2005 all it takes is someone to place a reciprocal to one of the "restricted" pages (can figure it out by browsing your robots.txt file). Spiders blindly will get it. I've seen google cacheing even https pages. The more info the better isn't it? :lol: Hi Mark thx 4 ya PM ;) well I am not that bothered about my stats page beeing 'page-ranked', it's pwd protectet anyway ;) but I'd love to kind of 'use' that pagerank to bring the real site further. therefor I'd love to know how it comes, that the stats first page (only!) is ranked 3. happy osc-ing :lol: dahui
New 
Recommended Posts
Archived
This topic is now archived and is closed to further replies.