Web Hosting Talk







View Full Version : Clustering


marksy
04-27-2001, 06:44 PM
Anyone have any good resources on clustering (Win and Linux) as it relates to hosting? Thanks

WaffenSS
04-27-2001, 07:51 PM
Maybe this will help:

http://www.advancedclustering.com/
http://cpcug.org/user/wfeidt/Misc/pctut.html
http://www.baltzer.nl/cluster/cluster.asp
http://www.ieeetfcc.org/

IPC PRO
04-28-2001, 12:02 PM
1) You need two, or more, computers running Linux. They should be the same version, distribution, and kernel version.

2) Add each node of the cluster to the "hosts" file, of each computer or set up a DNS with Hostname resolution. To use the "hosts" file, you will need to make a couple of changes. Under /etc you will find two files that will need to be edited. First, you want to edit HOSTNAME (This sets the computer hostname). Second, you will add each of the node computers to "hosts" file.

3) Setup rsh (Remote Shell). To do this, you need to make a couple of changes to the systems. First, you will need to remove the comment in inetd.conf so that rsh is allowed.
(example)
#shell stream tcp ....................
#login stream tcp ....................
(to)
shell stream tcp ....................
login stream tcp ....................

Next, you will need to create a ~root/.rhosts file needs to contain the hostname of each node. Each node will need a .rhosts file so the primary node is allowed to execute commands as Root. The primary node can be any computer, just remember that it will need to be the computer that starts up the cluster. Restart the inet daemon. You may need to install rshd, but most later rev,. server installs will include it.
(***Security concerns come up anytime you allow remote commands. I would work on the cluster on a private subnet.)

4) You need to download, and install, pvm-3.3.11-10.rpm (PVM stands for parallel virtual machine). This is what creates a parallel messaging cluster. The PVM RPM needs to be installed on each computer.

5) Once installed, you will need to create a pvm node file. This is a file you create and can have any name you choose. This file should have the hostname of each node within.

ie.
Node Apple
Node Bannana
Node Carrot
etc.

You should not use IP addresses, because rsh has problems converting IP addresses to hostnames. You can place the nodes in any order, just be certain to include the primary node.

6) Starting the cluster- Now you need to start the cluster. To do this you will run the pvm software on the primary node. You will also want to start the cluster using the node file you created. The command should look like this:

pvm nodefile

There are several ways to run a pvm cluster, look at /usr/src/pvm-3.3.11-10/ for examples and docs.

Also there is an XPVM that uses the same pvm rev. number. It can be found at freshmeat.net There are many graphical interfaces that can be run on the new cluster. Check out www.beowulf-underground.org .

(This was written by one of my instructors at Cal State Fullerton, Mr. James Rulison. )