the reverse records to my ip which is a dedicated server from IWEB timesout.. I'm pretty sure this isn't cool. I'm using WHM in case that makes any difference.

Should I contact my provider?

Yes, you will contact whomever owns those IPs.
They are the only ones that can delegate your IPs to different name servers or fix the ones that are currently having problems.