Re: Googlebot makes HTTP/1.0 requests without host header?

Cool, thanks, explains some things. That entire secrecy about how they
crawl, even though it may be necessary for some reason, in my eyes
seriously hampers the development of the internet at the fringes. My
site is for people in Bolivia --> few quality links other than
submissions to the directories and random posts in newsgroups, perhaps
an entry on Wikipedia or two (all of which is quite hmm) --> crap
coverage on Google. Not only my site, all of Bolivia. Ok, they're not
about democracy and empowering people, but about $$, so forget it. :-)