google asking every few days to re-verify site

Has anyone else had a problem where google sitemaps keeps asking every
few days to re-verify the site. This is a real pain because our site
has a custom 404 page so every time we have to turn that off ..
re-verify and turn it back on.