how to start an anonymous private proxy service on my windows VPS.

I would take a look first look on the bandwidth plan you have with your VPS plan (traffic+bw.) to avoid high fees for extra traffic.

What company are you with?
Do they allow proxy at all?

Do you mean VPN?If you use Virtuozzo,you need to ask your provider to enable the function first.And then start remote routing service.