dcsimg

The State of Oracle/Sun Grid Engine

Recent news and product releases could be cause for concern for the future of the open source Oracle/Sun Grid Engine.

Things change. Indeed, high tech is often a sea of change. For some open source software is a lifeboat in the storms of change. While everything else can be bought, sold, or demolished, your investment in open software is still yours. No where is this more important than in HPC where change is a way of life. Prior to open source, the ability to use hardware often depended on support contracts from vendors. If these companies sank, so did the support and keeping with the ocean metaphor, your prized HPC system has now become an expensive boat anchor.

Open source (and commodity hardware) changed this situation. Today, vendors can vanish, but it is still possible to update and modify the software. While the preceding philosophical rant may seem like the same old song and dance, there an open source scenario playing out in the HPC sector right now. Almost everyone is aware Sun was purchased by Oracle. It also appears that Oracle is not really interested in HPC. Once key piece of HPC software that Sun provided was Grid Engine. Grid Engine is a distributed resource scheduler that allows job management across clusters and workstations. As of version 6.2u5 Grid Engine was licensed under the OSI approved Sun Industry Standards Source License (SISSL). As I understand, Grid Engine is the only remaining piece of Sun software that uses that license.

Let’s take a look at the good news. According to DanT’s Grid Blog Oracle has plans for Grid Engine. As Dan mentions, Grid Engine does not compete with any Oracle product and like other resource managers has applications outside of HPC, which probably means Cloud based solutions.

Now let’s take a look at the, uhm, other news. As I mentioned, version 6.2u5 was licensed under SISSL and is in wide use. As a mater of fact, I have been using Grid Engine for over ten years. In addition to being very good at resource management, it has a very active support community. As far as open software projects go, it has a healthy Eco-system. Sun had been selling a supported version of Grid Engine as an official “product.” They also have been giving away “courtesy binaries” to the community. As I understand it the official product is slightly more polished with some added features than the courtesy binaries. As an aside, if there was ever a product (open or closed) where support is key it is distributed resource managers.

Back in June of 2009, Sun made a change in the evaluation license for the “Sun Grid Engine Product” starting with version 6.2u3. The license is for a 90 day evaluation. At the same time,
both source and courtesy binaries were furnished on the http://gridengine.sunsource.net site which is not the same as the product site: http://sun.com/sge.

There has been some concern due to this article, Oracle nixes free Sun GridEngine, goes 90-day trial, which as you read the title sounds pretty bad. The article talks about the new version 6.2u6 and the 90 day evaluation in the EULA that has been there since version 6.2u3. To be clear, as of right now, both the source and the open source courtesy binaries are freely available for 6.2u5.

The concern seems to center on the recent release of the 6.2u6 product binaries, but no coresponding update to the open source site (r the fact that no patches have been commited to the open source version since 6.2u5 release). I queried the Beowulf Mailing list and I think Joshua Baker-LePain said it best:

“To clarify a few minor points here (again, as *I* understand it), the eval
period is actually 90 days and does *not* apply to the “courtesy
binaries”, which are available up to and including 6.2u5 and are missing a
couple of modules. The concerns on the SGE list seem to have arisen
because a) there are no courtesy binaries for 6.2u6, b) no post-6.2u5
patches have made it to the source repository, and c) there has been
little to no word from Oracle as to future plans for source code access
and courtesy binaries.”

There is no doubt some things are changing, but it is not clear if these were in the works at Sun or are something Oracle is orchestrating. You can read some interesting threads on the SGE discussion list or on the Rocks List. This last post by Andy (I believe this is Andy Schwierskott who is on the Grid Engine team) on the SGE list seems to sum up the situation:

“the open source based courtesy binaries of Grid Engine 6.2u5 come with a free, unlimited license.

The Oracle/Sun Grid Engine 6.2 Update 6 release from http://sun.com/sge come with a 90 day time limited eval license only.

Things may not be as dire as they may seem at this point. The question on everyone’s mind is “What about the 6.2 Update 6 sources and courtesy binaries?” The has not been answered by Oracle and I think this is the concern of the community. It is possible that the open source versions may trail the product version by a few months as has been done with other projects. Or, Oracle is figuring out what to do with whole open/closed Grid Engine model. Integrating the two companies takes time and before we condem Oracle, it may be wise to give them a little room to do the right thing. Remember, it was Sun who introduced the evaluation license.

As I see it, there are two things that can happen. First, Oracle can continue to support the open source HPC community and enjoy the benefits that it imparts to the commercial version. A healthy open source Eco-system with lots of smart people helping you create/refine/improve your product while at the same time increasing “mind share” is the envy of any marketing department (and it does not come cheap). My message to the marketing crew, before you get all caught up in the lost sales numbers because of all the free as in beer users, think about how much it would cost to position your product in the top 3 resource schedulers. Also remember, many of those free as in beer users are also your beta testers, focus groups, and consultants that would normally cost you more money. Many of them are, after all, the rocket scientists everyone talks about.

The other option is that the project will fork. This option is very real and the recent Open Grid Scheduler project may kick into high gear in the near future should Oracle drop the ball as it were. The only thing, in my opinion, preventing the fork is if Oracle continues Sun’s embrace of the open source SGE community.

Let’s end on some more good news. If you are a open Grid Engine user, your are protected by the “Open Source insurance plan.” Should Oracle not embrace the open Grid Engine model and community, then the Open Grid Scheduler fork will happen. Of this I am sure. This is where the free as in speech part takes over and philosophical ideas turn into action.

Comments on "The State of Oracle/Sun Grid Engine"

margravezakhur

Well, in my experience, Oracle has a corporate culture to puff their own product to suits and they even try to sell to techs. With their main line a software product which is competing with some open source software, it is not likely that their corporate culture can withstand the shock of open source all that well, and I would expect their reaction to be defensive.

They have good reason to be defensive. I used to program monitoring for databases, and Oracle would have more than 200 issues a day to Netezza’s 30, MSSQL/Remedy’s 50 and MySQL’s 40 (None for Postgresql, where many of the same features Oracle has trouble with actually seem to work).

But expect Oracle’s management to be iffy and confused for several years on open source. They have to figure out how to deal with MySQL as well.

Reply

Thanks-a-mundo for the blog post.Really looking forward to read more. Will read on…

Reply

Thanks-a-mundo for the blog post.Really looking forward to read more. Really Great.

Reply

I have been absent for some time, but now I remember why I used to love this web site. Thanks , I will try and check back more frequently. How frequently you update your website?

Reply

I’m often to blogging and i really appreciate your content. The article has actually peaks my interest. I am going to bookmark your website and preserve checking for new information.

Reply

I’ve been browsing online more than 3 hours today, yet I never found any interesting article like yours. It is pretty worth enough for me. In my opinion, if all site owners and bloggers made good content as you did, the internet will be a lot more useful than ever before.

Reply

I’m still learning from you, while I’m trying to reach my goals. I definitely liked reading everything that is posted on your site.Keep the posts coming. I enjoyed it!

Reply

Hello! I just would like to give a huge thumbs up for the great info you have here on this post. I will be coming back to your blog for more soon.

Reply

I gotta favorite this site it seems invaluable very useful

Reply

F*ckin’ tremendous issues here. I am very glad to see your article. Thanks a lot and i am having a look ahead to touch you. Will you kindly drop me a mail?

Reply

I love your blog.. very nice colors & theme. Did you create this website yourself or did you hire someone to do it for you? Plz reply as I’m looking to design my own blog and would like to find out where u got this from. thanks a lot

Reply

Loving the info on this site, you have done great job on the articles.

Reply

Spenz, by far the fastest inputs for cash. Free but iPhone/web only

Reply

That may be the end of this article. Here you?ll come across some web pages that we believe you?ll value, just click the links.

Reply

Below you?ll uncover the link to some web sites that we believe you need to visit.

Reply

B9JNnb I truly appreciate this blog post. Really Cool.

Reply

F*ckin’ awesome things here. I am very happy to peer your article. Thanks a lot and i am taking a look ahead to touch you. Will you please drop me a e-mail?

Reply

You are a very smart individual!

Reply

I like the helpful information you provide in your articles. I’ll bookmark your blog and check again here frequently. I’m quite sure I’ll learn many new stuff right here! Good luck for the next!

Reply

We prefer to honor quite a few other internet web sites around the web, even when they aren?t linked to us, by linking to them. Under are some webpages worth checking out.

Reply

You can certainly see your skills within the work you write. The arena hopes for more passionate writers like you who aren’t afraid to say how they believe. All the time go after your heart. “In America, through pressure of conformity, there is freedom of choice, but nothing to choose from.” by Peter Ustinov.

Reply

Wonderful story, reckoned we could combine a handful of unrelated information, nevertheless really really worth taking a appear, whoa did one particular learn about Mid East has got much more problerms too.

Reply

Wonderful story, reckoned we could combine some unrelated information, nonetheless really really worth taking a appear, whoa did 1 master about Mid East has got more problerms at the same time.

Reply

Please visit the sites we adhere to, such as this a single, as it represents our picks in the web.

Reply

Wonderful story, reckoned we could combine a couple of unrelated information, nevertheless genuinely really worth taking a look, whoa did a single find out about Mid East has got more problerms at the same time.

Reply

One of our guests lately encouraged the following website.

Reply

We like to honor a lot of other world wide web websites around the net, even if they aren?t linked to us, by linking to them. Under are some webpages really worth checking out.

Reply

Great line up. We will be linking to this great article on our site. Keep up the good writing.

Reply

Sites of interest we’ve a link to.

Reply

Here are several of the web pages we advocate for our visitors.

Reply

Here are a number of the sites we recommend for our visitors.

Reply

Please stop by the web sites we comply with, including this one, because it represents our picks through the web.

Reply

Wow, marvelous blog layout! How long have you been blogging for? you make blogging look easy. The overall look of your web site is great, as well as the content!

Reply

158860 543459I actually like your writing style, excellent information , thankyou for putting up : D. 526071

Reply

Usually posts some pretty exciting stuff like this. If you are new to this site.

Reply

We like to honor many other web sites on the internet, even though they aren?t linked to us, by linking to them. Below are some webpages really worth checking out.

Reply

The time to study or visit the content or websites we have linked to beneath.

Reply

Here are some links to web pages that we link to simply because we feel they may be really worth visiting.

Reply

Leave a Reply

Your email address will not be published. Required fields are marked *

*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>