[Previous entry: "Adobe Acrobat security warning"] [Main Index] [Next entry: "Zaba database"]
08/23/2005 Archived Entry: "GoogleBerserkerBot"
Domain owners, check your web hosting logs. We just got a bandwidth warning from our web host. For some reason the Googlebot -- the program that Google uses to index web pages -- has gone berserk this month, and has downloaded our entire web site 40 times over! Others have reported this problem, too. If you're having problems, visit Google's bot FAQ. You may have to contact Google to get them to slow down.
For the time being we've set our robots.txt file to block Google entirely -- not an ideal solution, but it will get us to the end of the month. —brad