Re: Removed pages from sitemap, googlebot is still crawling them

myplancom@googlemail.com wrote:
> Does this
> mean I have to put them in a robots.txt file?

You might want to read up on my experience using robots.txt to do this
before trying that tack:
http://groups.google.com/group/google.public.support.general/browse_frm/thread/89d9359e27143ec1/43930aaafd43dc38#43930aaafd43dc38
I'm finding that google's Googlebot ignores my robots.txt file!

I came here wondering if I could use a sitemap to get around their
buggy code.

Creating a robots.txt that doesn't use Google's wildcard extension
would mean creating a robots.txt with hundreds of thousands of entries.