Getting the most out of your cluster is always important. But how exactly is that done? Do you really need to dissect your code and analyze every instruction to get optimal performance? Do you need to build custom kernels? Not necessarily. By testing some basic assumptions, you may be able to eke ten-node performance out of an eight-node cluster. Here’s how.
Cluster computing is great, or so it’s said. Cobble together a few thousand commodity servers, wire the machines together with Ethernet, grab some freely-available software, and with comparatively little expense, you can assemble a machine capable of calculating the meaning of life, the universe, and everything.
Or choose a problem that remains unsolved. According to the Hitchhiker’s Guide to the Galaxy, the computer Deep Thought has already solved the meaning of life, the universe, and everything, taking only a scant seven and a half million years to do so. Next problem, please.
But what if someone had optimized Deep Thought by 20 percent? Besides sparing oodles of generations a lot of waiting, what other gnarly questions could have been solved in those extra 1.5 million years? How about, “Why are hot dogs sold in packs of six, while hot dog buns are sold in packs of eight?”
And what about your cluster? Do precious processor cycles lay undiscovered in your system? Even if you’re not solving intergalactic quandaries or designing planetary-scale supercomputers, the right cluster optimizations can improve jobs of all sizes.
Follow the Money
Optimizations are like a journey. So, let’s start where all journeys begin: getting money.
If your budget was unlimited, there’d be little reason to optimize. With wads of cash, you could just throw money at performance problems, buying mass quantities of the fastest performing hardware man has ever known. However, since most researchers have a budget, constraints apply. Optimization, therefore, is an ongoing attempt…
Please log in to view this content.
Not Yet a Member?
Register with LinuxMagazine.com and get free access to the entire archive, including:
