If you installed from a source, than you should go into the directory of the program you compiled:
If you installed from a rpm than use:
yum remove program
---=== RoseHosting.com Admin ===--- Linux Cloud Hosting - linuxcloudvps.com Linux VPS Hosting - rosehosting.com
High Quality Linux virtual servers with lots of Guaranteed RAM and HDD space, Impeccable Service.
If you have not installed using yum, it will not get removed with yum remove command. You can use the "which binary_name" to check the path associated with the binaries. If the process is running, to get more details regarding the files it is associated use the following command, "lsof -p Procedd_ID"