Help, I’m being raped by Googlebot!

Friggin’ Googlebot is crawling all over pcrepo, even though I told it NOT TO DO THAT. My robots.txt file has been updated to disallow svnro for most of the day. Google really should have a facility for web-masters to be able to force a reload of robots.txt in Googlebot. They’re going to hit me thousands of times before this is over. :(

Leave a Reply