Ok What I wanna do is start a backup hosting site, where customers push there data to my server and we backup in a safe and secure spot. What kind software do I need to accomplish this task?

You don't need software unless you are giving your clients a control panel.

All that's needed is shell access, with rsync or scp installed on the server.