Results 1 to 2 of 2
Thread: Yahoo bot scanning my forum
-
06-05-2005, 05:29 PM #1Web Hosting Evangelist
- Join Date
- Nov 2003
- Posts
- 536
Yahoo bot scanning my forum
Does anyone know how long the bot scans for?
It's registering as 454 guests on my board, my CPU usage has gone up because of the Gzip module
Top Process %CPU 79.0 gzip
Has anyone else had this problem?
-
06-05-2005, 06:30 PM #2Retired Moderator
- Join Date
- Sep 2004
- Location
- Flint, Michigan
- Posts
- 5,766
It'll spider everything it can, take a look at robots.txt to help prevent this (wish I could be more help).
█ Mike from Zoodia.com
█ Professional web design and development services.
█ In need of a fresh hosting design? See what premade designs we have in stock!
█ Web design tips, tricks, and more at MichaelPruitt.com