dcsimg

Intel’s Single-chip Cluster Computer (SSC)

Intel recently released an experimental processor that resembles a cluster on a chip.

Intel has a new 48-core experimental processor. I want to discuss the technology, but first I need to rant a bit. The PR contrived headline calls it a “Single-chip Cloud Computer.” Arrgh, they are even using an acronym calling it the SCC chip. Where to begin? First, when this project was started, I doubt the hardware engineers at Intel said, “Hey let’s build a processor for the cloud. You know that nebulous concept that is years away.” Second, I am sure they have good technical reasons for designing this chip, but sorry Intel PR geniuses I doubt it was for “The Cloud.” Yes, “The Cloud,” that vague but ever so trendy name for timeshare/grid/Internet-computing that gets tacked on to every technology news story I read. Let me try and help you out here. Computers can run almost anywhere, in an office, a house, a car, even on an airplane while flying through a cloud, but, you don’t “run a cloud on a processor” unless you are simulating them, which by the way some HPC people are apt to do. Please stop using the word “Cloud” to grab headlines. Intel makes cool stuff, let that be the story. There now I feel better.

Let’s move on to the real issue — parallel computing. In case you have not noticed, processors have more cores than they used to. In some case eight or sixteen times more cores. If this did not surprise you, then maybe this will. Designers cannot continue adding cores the way they have in the past, which is in an SMP cache coherent kind of way.

In todays multi-core CPUs there is special hardware that allows the other cores to know if data in it’s cache is invalidated by another core. For instance, if two cores are working with the same value of X and one of the cores changes X, then the other core mus be told that the value of X in its cache is no good, plus the value of X in main memory is also invalid (often called “dirty”). These hardware mechanisms work transparently and the programmer does not need to be concerned about cache coherency (Although a poorly written program can be made to run slowly due to coherency issues). Thus, we have things like Symmetrical Multiprocessing (SMP) that allows multiple programs, possibly threaded, to run at the same time on multi-core systems.

Cache-coherency limits scaling. The more cores, the more caches, the more difficult it becomes to keep track of everything. This is one reason why MPI programs on clusters scale so well. The memory of each node is private and there is no coherency issues between nodes. In essence, memory is copied from node to node through the MPI message passing protocol. We’ll come back to this in a minute, but first let’s take a closer look at the SCC, sorry the Intel Parallel Processor.

The chip is composed of 24 two-core tiles. Each tile has two IA-32 (that is 32 bits) cores, cache, and a router for inter-tile communication. The router provides 64GB/s interconnect bandwidth to the other tiles, which are configured as a mesh as shown in the figure below. There are four memory controllers and and I/O controller connected to the router network. You can find more details and figures in this short technical paper (pdf).




(Intel Image)

There are two interesting designs features that are unique to this processor. The first is the cache coherency protocol and the second is the power management. I will not say much about the power management other than it is important and seems to work quite well. My concern is the cache coherency protocol, or lack thereof. The designers realized that it was not feasible to include circuity for a 48-way cache coherency so they did what any hardware designer does, push it off to the software people. Thus, each core runs independently and has its own private cache, there is no coherency hardware.

While this is not always the best move because it may break existing software, it does seem like an idea worth trying. The mechanism works as follows. In addition to standard cache, each tile has a 16 Kbyte Message Passing Buffer (MPB). Each core can transfer data directly from its MPB to another cores MPB. Indeed, once data is sent, it is removed so that there is only one owner of any data at any time. Data never leave the processor and do not travel through main memory.

The explicit use of the MPB by software is quite unique, but should have MPI programmers jumping for joy. The MPB model is basically designed for message passing. Recall, message passing assumes all processors have independent cache. Porting MPI programs to these processors will be almost trivial. Of course, memory access is always an issue, but we can push that back on the hardware guys. It is also possible to implement things like OpenMP over the MPB, but this will require a little more software finesse under the hood because OpenMP is a threaded model that relies on cache coherent SMP architectures. End users may not need to change anything, however. There is even a modified version of Linux available. By the way, a separate Linux kernel runs on each core. It cannot run across the whole processor because it does not support cache coherency.

Here is the really cool thing about this idea. If you want to write software for this new gizmo, use MPI. Oh, that is right, you already do. It is comforting to know that your investment in cluster software will keep paying dividends. Cluster computing is scalable parallel computing, which is the only way we can keep pushing the performance curve both at the server level and now at the processor level. You will have to excuse me if I don’t call it the “Single-chip Cloud Computer”, but rather the “Single-chip Cluster Computer.” The acronym is the same and somehow I have to think it is more what the designers had in mind.

Comments on "Intel’s Single-chip Cluster Computer (SSC)"

indivar

The concept is nothing new, and there are manufacturers who have been doing this for a while now – A 54 Core Chip specifically for Java Apps – http://www.azulsystems.com/technology/vega . From a user perspective, the only difference would be that Intel\’s chip is more generic in nature with OpenMP and Message Passing (MPB) support, making it possible to port existing applications. MPI application may require extensive rework though.

But a great approach nevertheless. I feel, it could seriously create a major impact in HPC and IaaS areas by increasing core density in a single rack or location. They should come up with the x86_64 version for any real world adoption though.

madhukarbhat

A first read of the article made me think of micro-kernel based OSes, namely GNU/Hurd. Though really speaking, I don\’t have the foggiest about how suitable it might be for this kind of hardware.

I do agree with all the ideas you have introduced to your post. They’re very convincing and can definitely work. Nonetheless, the posts are very quick for beginners. Could you please prolong them a bit from subsequent time? Thank you for the post.

I think this is a real great post.Thanks Again. Much obliged.

I will right away grab your rss feed as I can’t find your e-mail subscription link or e-newsletter service. Do you have any? Kindly let me know in order that I could subscribe. Thanks.

I like what you guys are up too. Such smart work and reporting! Keep up the excellent works guys I?¦ve incorporated you guys to my blogroll. I think it’ll improve the value of my web site :)

Superb points totally, you may attained a brand brand new audience. Precisely what may perhaps anyone suggest regarding your posting you made a couple of days before? Virtually any particular?

srY4Uu Thanks a lot for the article post.Thanks Again. Cool.

Great line up. We will be linking to this great article on our site. Keep up the good writing.

I am curious to find out what blog platform you are using? I’m experiencing some small security problems with my latest website and I’d like to find something more secure. Do you have any suggestions?

Heya! I just wanted to ask if you ever have any trouble with hackers? My last blog (wordpress) was hacked and I ended up losing many months of hard work due to no data backup. Do you have any methods to stop hackers?

Sites of interest we’ve a link to.

Very couple of web sites that come about to be in depth below, from our point of view are undoubtedly very well worth checking out.

I’ve read a few good stuff here. Definitely worth bookmarking for revisiting. I wonder how much effort you put to make such a fantastic informative web site.

Although web sites we backlink to below are considerably not connected to ours, we really feel they are in fact really worth a go via, so have a look.

I’m not that much of a internet reader to be honest but your blogs really nice, keep it up! I’ll go ahead and bookmark your website to come back in the future. All the best

Below you will find the link to some web sites that we think you must visit.

We like to honor numerous other world wide web websites on the net, even though they aren?t linked to us, by linking to them. Underneath are some webpages really worth checking out.

Say, you got a nice blog article.Really thank you! Keep writing.

Every once inside a when we select blogs that we read. Listed beneath would be the most up-to-date websites that we decide on.

Thank you so much for giving everyone an extremely superb possiblity to read articles and blog posts from this blog. It is always very awesome and also full of a lot of fun for me personally and my office fellow workers to visit your blog minimum three times a week to read the fresh stuff you have. Of course, I am actually motivated concerning the terrific advice served by you. Selected 3 ideas in this posting are undeniably the most efficient we have had.

Usually posts some quite interesting stuff like this. If you?re new to this site.

“Awesome post. I’m a normal visitor of your blog and appreciate you taking the time to maintain the nice site. I will be a regular visitor for a really long time.”

Nice post. I was checking continuously this blog and I am impressed!
Very helpful info particularly the last part :) I care for such
information a lot. I was looking for this certain information for a very long time.
Thank you and best of luck.

Please stop by the web sites we comply with, which includes this one, because it represents our picks in the web.

good post,it is useful to me and others,please just keep it on….
Wholesale 68219a Oakley Sunglasses ID8210261 http://www.fleetsale.ru/new-arrival-oakleys-279.html

The information talked about within the post are a few of the most effective accessible.

The time to read or stop by the subject material or internet sites we’ve linked to below.

Wonderful story, reckoned we could combine a couple of unrelated information, nevertheless really worth taking a search, whoa did one particular master about Mid East has got more problerms at the same time.

Please check out the internet sites we follow, like this 1, as it represents our picks in the web.

One of our guests just lately advised the following website.

Usually posts some quite interesting stuff like this. If you are new to this site.

Very handful of sites that happen to become comprehensive below, from our point of view are undoubtedly properly worth checking out.

You actually make it seem so easy with your presentation but I find this matter
to be really something which I think I would never understand.
It seems too complicated and very broad for me.

I am looking forward for your next post, I’ll try to get the hang of it!

Just beneath, are several entirely not related web sites to ours, even so, they are certainly worth going over.

You made some decent factors there. I appeared on the web for the problem and found most people will associate with together with your website.

Check below, are some completely unrelated internet websites to ours, however, they’re most trustworthy sources that we use.

The time to read or go to the material or web pages we’ve linked to beneath.

Usually posts some pretty intriguing stuff like this. If you are new to this site.

Every when in a while we opt for blogs that we study. Listed below would be the newest websites that we select.

The time to study or check out the content material or web sites we have linked to beneath.

I always accustomed to study component of writing in news papers
but now as I am an individual of internet thus from now I am using net for articles or reviews, as a
result of web.

My web site … HongEKetcham

Every as soon as in a while we pick out blogs that we study. Listed below are the most current internet sites that we decide on.

Very handful of internet websites that transpire to become in depth below, from our point of view are undoubtedly nicely really worth checking out.

The time to read or check out the content or web pages we’ve linked to below.

Usually posts some very exciting stuff like this. If you are new to this site.

The information talked about inside the article are a few of the most beneficial offered.

Although websites we backlink to below are considerably not connected to ours, we feel they are actually worth a go by, so possess a look.

Very few internet sites that happen to be in depth beneath, from our point of view are undoubtedly nicely worth checking out.

Every after in a when we decide on blogs that we study. Listed beneath would be the most current internet sites that we choose.

Leave a Reply