Hello, I need to check approximately 15,000 websites for validation. I have messed around with some of the tools out there to do so but I would like your opinions of what to use. Obviously I need something that is easy to use and fairly fast because of the amount of websites I have to check.

I would prefer something that could go through entire directories at a time instead of having to do one directory at a time.

I found this tool for 3 layers: appserv.rehab.uiuc.edu/fae/
Sorry it's not linked, not enough posts yet.

Thanks!