A few days ago I've uploaded a new site with ~150 pages of content. Whole website is like ~700kb in size as there are no images, just plain HTML. Yesterday I've found that search engine bots have burned 2GB bandwidth in one day! I thought that cPanel is kidding so I moved the site to another server. A day later I logged in to cPanel and I saw 2GB again! Well, that's not a problem but I'm interested how is that possible. Maybe it's just because my website is so new?
I had the msn search bots when they were in beta chewing up that amount of traffic per day. Basically, it seemed to check & recheck data and links that would reference each other would all be checked multiple times.