You don't need a Vlan for yourself since this is using a crossover cable.
Also, doing it with basic ifconfig statements on the command line will work until you reboot, then it won't work. My guess is that John is a *BSD guy. =)
The first thing you need to do is to make sure the OS is seeing both of your NICs, you can do this by typing 'ifconfig' with no options. You're looking for an eth0 AND an eth1. If both of those are there, then the hard part is done. =)
On a Redhat based system (Redhat 6.2, 7.x, 8.x, 9.x) do this.
Once you're in there, do an 'ls' and you'll see a bunch of files, the ones you're interested in are 'ifcfg-eth0 and ifcfg-eth1'. These are the configs for both of these NICs.
Now do a "/etc/rc.d/init.d/network restart" and wait a second, because it's going to stop/start networking for you. You'll be fine as long as you type 'restart' and nothing else. =)
Now if you do an 'ifconfig', you should see eth1 with the IP information you just setup. Go ahead and repeat everything for your other server, just make sure you change the IP to 192.168.0.x wher x is a number between 3 and 254.
Let me know if it's another distro and I can get you instructions on that as well.
Thanks so much n2deep - worked perfectly. Now one more thing -
I am using the second server for just MYSQL DB and connecting to that server IP in my PHP config files. How should I set the servers to use the eth1 connection for data transfer and not the main IP (huge bandwidth )?