Could anyone please give some specific links or buzz words for spidering programs or scripts that I could look up and play around with? I'm looking for anything freeware if possible.

There isn't much out there anymore.
You might want to check out http://cgi-resources.com
or hotscripts.com