Emailing HPC

Email is not unlike MPI. The similarities may help non-geeks understand parallel computers a little better.

Parallel computing seems like a new concept to many people. In particular, multi-core now requires those that program for a living to grasp the basic ideas behind parallel computing. The concept of “parallel” should not be a surprise to anyone, however. The world is a very parallel place. We (humans) are social animals and thus must work (progress) together to solve many common problems, which is a pretty good definition of parallel computing.

Most news stories always provide a quote that relates the speed of a new parallel computer to a single processor. (e.g. “If this program were run on a single processor, it would take 100 years to finish.”) Sounds like breakthrough work, but no one really mentions the building that holds the cluster would take one person 50 years to build. Those types of statements seem silly. So why do parallel computers seem so exotic?

Working together seems natural and obvious. Indeed, parallel computing has been around for a while, but not in the mainstream. When venturing into parallel computing, there are concepts that are very familiar to any construction crew (like those building a new computer center); Amdahl’s Law of parallel computing is one example. It basically says you can’t go faster than the slowest single step. Anyone who has worked on a team project understands this. Message passing is another concept with which everyone is familiar — probably more than they know. I am thinking specifically of email which is probably the largest parallel human/silicon computer on the planet. Think about it. There are bidirectional messages connecting meat bag processors (people). Not only are commands sent and acknowledged, but data are also sent over this channel. For instance, consider a common email conversation:

Taylor sends to Lauren: Add your results (a command) to the attached document (the data)
Laure responds: Okay
Lauren sends to Taylor: The new version (a command) is attached (the data)
Taylor responds: Okay

Email also works as a universal transport mechanism. Pictures, documents, spreadsheets, music, all are sent via email. Actually with the right client it can be a very smart mechanism because it will often associate an application with the data payload.

The similarities to a typical HPC program are interesting. A large amount of collaborative (parallel) work is done via email. For instance, a document is sent to a group of people for processing (MPI_BCAST). They each complete their part and send it back to the team leader (MPI_SEND) who then does a reduction of the data. There may also be some two-way communication with various individuals (MPI_SEND/MPI_REC).

Like MPI, Email is “sent” when it is copied from the user to the host for transport. There is no “blocking” sends or receives or barriers, but these kinds of things could be worked out by the human endpoint processors. MPI requires a more explicitly send/receive structure, where sends and receives need to be matched. Email is totally asynchronous.

The MPI_COM_WORLD equivalent in email is literally the whole world, and therein lies a problem because a message will be accepted from anywhere — and thus SPAM. In general, MPI has a defined subset of endpoints, but unexpected messages can still be received if the endpoint is waiting for input. Email is in a constant receive loop.

Similar to an MPI program, data movement can be optimized by observing how it is used. For example, it is not uncommon for someone to create excessive email traffic by sending a large video file to all their friends. This type of broadcast is allowed in the email protocol. By placing the video in one location and broadcasting a short pointer to the video (e.g. posting on youtube and sending the URL to your friends), the endpoints can then use this data as they seem fit. A similar method is the use of Google Docs. A central copy (global data) is located in one location and pointers to the data are sent to the endpoints (collaborators). The endpoints can download some, none, or all of the global data. Similar concepts are used in parallel programming where optimal data movement can improve performance.

While I am not advocating “email based HPC,” I do think that it may be possible to build a simple generalized protocol on top of email that allows one to “play” and learn about parallel computing. For instance, a participating client (like your desktop) could handle “MPI-Mail” from other machines. If it were a matrix multiplication application and your client had the right handler program, it would just “know” what to do with it, process it and send a result email back to the sender (or another system designated by the sender). The human never sees the email, it is all done in the background.

Similar to BOINC, there could be a general framework for applications. Those that are developed using “MPI-Mail” can be run on “willing” clients. Of course, I glossed over a pile of things that would need to be addressed, but in principle it would make an interesting Senior project.

Finally, what I just described could also be thought of as “bot-net” programming language, so keeping it as a local academic exercise may be the way to go. In any case, the next time someone asks you, “What is MPI and parallel computing?”, just reply, “Email for computer processors, without spam.”

Comments on "Emailing HPC"

Are you looking for a diamond necklace for your ladylove?

Here is my page … The Latest Hultquist Jewellery Collection – Margery,

Jewelry is a wonderful accessory which can be purchased
in a variety of metals and styles. In International market one particular metallic which has gained in recognition quite enormously previously ten years or so
is that of platinum.

my homepage Shop Hot Tomato Jewellery (Timmy)

Gold was quickly changed by diamonds, which fervently bought the nickname of being a girl’s greatest friend.
A lot of that is nonetheless changing. With the introduction of inspirational charms and sterling silver charms by lots of jewellery stores, people are more and more
trying ahead to these choices.

Feel free to surf to my webpage :: New Hultquist Jewellery Collection (Marcela)

Its design would have a heartening effect.
The worth, at 179 pounds, might appear a bit steep, however the
product is value it.

Also visit my homepage – Hultquist (Leola)

Few of the essential care tips for gold plated Jewelry advices to maintain the Jewelry away from the getting
in contact with exhausting surfaces.

My webpage; Hot Tomato Bracelets, Krystle,

One of essentially the most well-known items of pearl jewellery belonged to
Anne Boleyn, the second spouse of Henry VIII.

my page … Fb post regarding Jewellery

The tradition of sporting silver has been exsiting for a long time.
Without appearing to be too garish, this mental
has created an amazing sheen for ladies who put on them.

my site … Hultquist Jewellery Collection Autumn Winter 2015

The sample has been flat to this point, however once you pull the ends
together it will bow out to kind a three-dimensional form.
You can tie a knot should you like, but you need to
get a secure becoming a member of just by weaving the threads out and in of the beads.

Review my website … Hultquist Jewellery – Kristin,

My web blog: where to buy diamonds – Francesco -

Apparently it was fairly unhealthy, because there is a long and elaborate document of the dead.
As far as we know, it grew to become so there that
even their manor was burned to the bottom, and the vintage bracelet was
one of the items that was destroyed by the fireplace.

Also visit my homepage :: Hultquist Jewellery Collection 2015; Clinton,

With excessive f-quantity eg f/22 or f/11, when taking jewellery pictures,
parts that are near digital camera will likely be targeted in addition to components which are additional away.

Take a look at my web page; Hultquist Jewellery – Angie -

Leave a Reply