The Blog of Harald

Did the google crawler just hack up a furball or something?

Bandwidth use on all of my hosted sites (except controlledflight.ca, for some reason) spiked in the last 24 hours. The culprit was always 66.249.72.114 (crawl-66-249-72-114.googlebot.com.), which seems to have fetched every page on all of the sites in the last 24 hours. This is much more aggressive than normal for google…

I’m not complaining; I like my google juice! Just wondering if anyone else has seen this…

Update: the flood has subsided. I note, with amusement, that the same crawler fetched this page at 12:27:27 today, a mere 3 hours after I wrote it :)