x
Loading
 Loading
Hello, Guest | Login | Register

The Coming of Diskless Clusters

With advances in many facets of networking, diskless clusters are now quite practical. Better yet, nodes without local storage are cheaper to build and cheaper to maintain. Here’s a survey of the relevant technologies and techniques.

The world of clusters is fun and unique because there are so many ways to customize the design and implementation of your cluster. One design that’s becoming increasingly popular is the diskless cluster — that is a cluster with no hard drives in the compute nodes.
Diskless clusters are now practical to build, due to the convergence of several key technologies, including affordable, high-speed interconnects, high-speed network file systems and storage network protocols, MPI implementations with MPI-IO, and high- performance processors.
Why no hard drives in compute nodes? Removing storage hardware from each machine reduces cost, cuts down on noise, lessens cooling requirements, and curtails power consumption, and minimizes the number of moving parts in a cluster, thereby improving reliability. (Indeed, several studies indicate that hard drives are the least reliable component of cluster configurations.)

Where Did the Operating System Go?

One of the first questions asked about diskless clusters is, “Where is the OS for each node?”
For small clusters, you can use the Network File System (NFS) to mount a remote root (or /, the topmost directory in a Linux system) on each of the compute nodes. For larger clusters, with hundreds or even thousands of nodes, you can use a portion of each node’s RAM as a RAM disk and place a useful subset of the operating system within it. (To minimize the amount of RAM needed by the RAM disk, remove all non-essential daemons and applications from the distribution…

Please log in to view this content.

Not Yet a Member?

Register with LinuxMagazine.com and get free access to the entire archive, including:

  • Hands-on Content
  • White Papers
  • Community Features
  • And more.
Already a Member?
Log in!
Username

Password

Remember me

Forgotten your password?
Forgotten your username?
Read More
  1. GP-GPUs: OpenCL Is Ready For The Heavy Lifting
  2. HPC Madness: March Is More Cores Month
  3. HPC Turn-Offs: Power Control
  4. The Cost to Play: CUDA Programming
  5. The HPC Software Conundrum
Follow Linux Magazine
Rackspace