Re: Robots.txt timeout
Sebastian,
When I view my webstats via Urchin, I can see that the googlebot visits
my site multiple times daily, and the robots.txt file is requested.
There is no .htaccess file and the robots.txt clearly does not block
any google bots.
There is something I am not getting, I just dont know what!
Thanks for helping,
Brad
0 Comments:
Yorum Gönder
<< Home