Cheap Stuff: Trends in Commodity HPC

Commodity trends at the low end are generating interesting ideas in HPC

Now that I am finished with my SC09 videos, I assume some of you are thinking “it is about time.” In my defense, I wanted to post and discuss the videos at a slow pace so that you can take the time to see my cutting edge work (cough, cough). By the way, if you like or dislike the video idea, please let me know in the comments. Although it may not look like it, doing the video is hard work. I spend a lot of time running around the show trying to make appointments and give everybody their 10 minutes (or less) of fame. Plus, it takes time to edit the video.

While I was writing about the videos, I happened on this somewhat sensational story about an inexpensive $100 Wii balance board working as well as a $17,885 medical device. I won’t bore you with the details, but comments about this story often seems to center around how the medical company is gouging customers. The naive view certainly would produce that opinion. Of course, HPC folk are cut from the rocket science cloth and a little more analysis is in order.

Consider yourself in the medial device market. You identify a product need, perform the research and development, gain the various certifications and approvals needed, hire a sales force, and set out to make your mark. Getting your product to market required a lot of capital and you price your product based on a competitive analysis and your development costs. In any case, your price is based on a highly focused market (i.e. the number of units you expect to sell is probably be in the thousands).

Let’s change your job. Now you are working for a consumer gaming company. Smart people in your company propose a dohicky that adds to the console experience and works very similar to the medical device. You spend about as much money as the medical company did on their product, but now you price it 100 times less than the medical device because you plan on selling 100 times more of the product.

There are other differences between between the markets as well. Supporting a medical device is quite a bit different than a consumer device. Consumers can often wait for repairs, professionals often lose money when equipment does not work.

Looking at the details of the two markets gives some insight into why the costs are so different. And, if you are in the medical device company you may want to take a good look at the “toy” that works about as good as your professional version. You can bet an entrepreneur is thinking about this situation.

If you have not figured it out yet, this same trend is what has been fueling the HPC market for the past ten years (or more). Technologies from the bigger markets have found their way into the HPC market and redefined the price to performance curve. The x86 HPC story is well known at this point. Are there any new products entering the consumer markets that may have a play in HPC?

The obvious answer is GP-GPU technology. I believe the GP-GPU idea is going to play out in a big way this year. I also think software will still be an issue — just as it has been ever since someone got the idea to do more than two things at the same time in the same program. The mass market numbers for GP-GPU processors guarantee that low cost parts will be available, but I think that is only half the story.

One development I have been watching very closely are low powered CPUs. I consider low power to be in the 25 Watt or less range. There seems to be plenty of commercial incentive to produce these processors for things like netbooks, e-book readers, cell phones, and even something called and ibook. Before you chuckle, have a look at this announcement.

If you recall, a company called SiCortex produced supercomputers using lower power MIPS processors (MIPS processors are a commodity design found in may embedded devices). Their idea was to use large amounts of low power processors connected with a fast network.

The idea worked quite well and were it not for the economy falling over last year, I might still be writing about them. In any case, large numbers of small lower powered processors offer some advantages in terms of cost, power, and cooling. Using many cores also means that codes must be scalable and finer grained. A fast low latency network helps with this issue.

In addition to low powered processors you need things like motherboards. In terms of HPC better densities can be had with smaller cooler motherboards. Ideally a small low powered motherboard should have enough memory slots, at least one GigE port, and a PCIe slot for a possible high speed interconnect. These types of boards are starting to emerge in the market. For instance SuperMicro has just introduced the
X7SPA-HF a Mini-ITX motherboard (6.75″ x 6.75″, 17.15cm x 17.15cm).

This motherboard uses the new Atom (Pinetrail-D) dual core 17 Watt processor, as two Intel GigE ports, a x4 PCIe slot, and can be passively cooled. Passive cooling means boards can be packed in a more dense fashion with less fans and noise.

If you were to combine smallish GP-GPU chips with these low powered processors, then you would be boosting your HPC credibility quite a bit.

AMD’s Fusion and the new Intel Clarksdale are examples of this type of integration. NVidia is also in the fray with it’s Ion2 chipset that is rumored to have at least 32 stream processors in a low power package. Now that puny little low power node doesn’t seem so useless.

Another interesting aspect of this approach is the potential for very low cost nodes. Of course, you will need a lot more nodes than you normally have in a standard clusters, but the nodes themselves would cost quite a bit less. It may be possible that the low price points make the nodes almost disposable (i.e. not really worth fixing, just add a new one).

In closing, there are reasons I am proffering this idea. The low cost, low power, integrated hardware is on it’s way. The commodity market is demanding it. I’m not sure it will work for HPC, but we should be taking a close look at this type of approach. Next time you are standing on your wii balance board doing yoga (or ski jumping) remind yourself that it was not too long ago that using x86 processors for HPC was considered a daft idea. And, the first time you heard about some HPC hacker contorting a video card into solving linear equations or searching genome sequences you probably chuckled. Not so funny now is it?

Comments on "Cheap Stuff: Trends in Commodity HPC"


Sounds more than a little bit like the IBM Blue Gene idea recast in an x86 and/or GPGPU mold. Blue Gene for the masses?


>For instance SuperMicro has just introduced the
>X7SPA-HF a Mini-ITX motherboard (6.75? x 6.75?, 17.15cm x 17.15cm).

>This motherboard uses the new Atom (Pinetrail-D) dual core 17 Watt
> processor, as two Intel GigE ports, a x4 PCIe slot, and can be passively
> cooled. Passive cooling means boards can be packed in a more dense
> fashion with less fans and noise.

Went to the SuperMicro pages but their board specs indicate two fan headers. Any examples of boards/cases that have no fans?


we have recently started a somewhat related project — not aimed at HPC, but peta-scale storage — based on commodity hardware:


the supermicro mini-itx board is one of the options we\’re considering for our current design.



In Reply to MadDog,

I have been playing with lower power, but not absolutely fanless


I recently tested this system with the processor (65W)
fully cranked up (hpl, gromacs, cpuburn) and I was able to keep
it cool with a large copper heat sync and the front fans. Of course
I will be attempting to put 8 Mini-ITX low power boards in this case at some point.


Scicortex had terrible memory performance.

I like the valuable information you provide in your articles. I’ll bookmark your weblog and check again here frequently. I am quite sure I will learn lots of new stuff right here! Best of luck for the next!

Great – I should certainly pronounce, impressed with your site. I had no trouble navigating through all tabs and related info ended up being truly easy to do to access. I recently found what I hoped for before you know it in the least. Reasonably unusual. Is likely to appreciate it for those who add forums or something, site theme . a tones way for your customer to communicate. Nice task..

Robert:Just following up on your comment on my sien#Thatks&.8230;I really hope Hoffman pulls this off. It could change the way the GOP looks at 2010.I had to cut off comments on the post because some lefties got on there and were spouting some disgusting things. I don’t mind a little rough language but this stuff was embarassing, personal and foul. Thats the liberal left for you.EJ

I value the blog post.Thanks Again. Keep writing.

We prefer to honor lots of other internet web sites around the internet, even when they aren?t linked to us, by linking to them. Below are some webpages really worth checking out.

67Z8Tv You, my pal, ROCK! I found exactly the info I already searched everywhere and simply could not find it. What a perfect web site.

I’m still learning from you, while I’m making my way to the top as well. I certainly enjoy reading everything that is posted on your site.Keep the aarticles coming. I loved it!

Great post.Much thanks again. Much obliged.

I really like and appreciate your blog article.Much thanks again. Much obliged.

Hi to every , since I am genuinely keen of reading this weblog’s
post to be updated on a regular basis. It consists of
good material.

Write more, thats all I actually have to express. Literally, it seems like as though you relied on the video
to make your point. You definitely determine what youre
speaking about, why waste your intelligence on just posting videos
for your blog when you could be giving us something enlightening to learn?

Here is my webpage AlvaRCambero

Leave a Reply