With out going into to much detail, I would say a solid infrastructure that is easily scalable.
I agree with this, and also on the people and processes side. Ensure that from the start, you have processes in place so things are easy to scale as a company grows.
There's a book I like that goes over this concept in a more general case (like not specific to hosting companies), called E-Myth Revisited.
So for example, even if you're only one person right now, you should still use some type of CRM, and document all processes as you establish them. It will make things go much more smoothly when you grow, and also help if you are ever acquired.
vpsBoard - An active resource for all things Virtual Private Servers. Tutorials, Guides, Offers and more!
Come join the conversation! 90,000 posts and growing daily! The fastest growing hosting forum around!
I think the first things that you have to think is the Data Center or any other company your server will be place on... Because without a good DC (ex: data lost, often server down,etc...), all other things will be useless..