var sidebar_align = 'right';
var content_container_margin = parseInt('350px');
var sidebar_width = parseInt('330px');
robots.txt with wildcard?
Googlebot is eating up about 30GB bandwidth per month.
I want to prevent him (and other robots) from spidering:
and all derivatives thereof (e.g. http://www.mysite.com/directory1/pag...riable1=value1)
Is this possible with robots.txt? How would the code look?
Will this work?
or do I need to somehow specify a wildcard, e.g.
Thanks for your help!
Matt (if this is Matt!),
You might have better luck on this forum here:
They seem to be robots.txt gurus
— For businesses with more important things to do than worry about their hosting.