tranceformer
12-31-2007, 01:07 PM
I recently checked my stats page and noticed an anomaly-googlebot is consuming about 30GB of bandwidth on my site per month.
if I wanted to block googlebot from www.mysite.com/directoryA/fileZ.php, how exactly would I do so? What would robots.txt look like, and where would I put robots.txt, in the directoryA directory?
if I wanted to block googlebot from www.mysite.com/directoryA/fileZ.php, how exactly would I do so? What would robots.txt look like, and where would I put robots.txt, in the directoryA directory?
