Can anyone recommend a spam filter that can be installed on a red hat server?

Spamassassin with razor works well.

http://spamassassin.apache.org/index.html

Open source

You could also setup exim to use common spam blacklists such as spamhaus.

http://www.talkroot.com/archive/topic/160-1.html