I have setup my own Windows box running apache and stuck a site on it. I user dyndns.org for my name servers but how do I handle another site on the same box? I mean do I use dyndns to direct to a seperate folder or what?

Set up apache to use virtual servers.

Then point you various sites to your IP

http://httpd.apache.org/docs/vhosts/name-based.html