dcsimg

Drizzle: Rethinking the MySQL Database Kernel

Drizzle is a re-thought and re-worked version of the MySQL kernel designed specifically for high-performance, high-concurrency environments. In this exclusive article, MySQL guru Jeremy Zawodny takes an inside look at the goals and state of Drizzle development.

If you visit the Drizzle project homepage, it explains:

Drizzle is building a database optimized for cloud and [network] applications. [Drizzle] is being designed for massive concurrency on modern multi-cpu/core architectures. The code is originally derived from MySQL.

In other words, Drizzle is a re-thought and re-worked version of the MySQL kernel designed specifically for high-performance, high-concurrency environments. The goal is to make Drizzle an extensible database kernel that runs extremely fast on emerging hardware.

Much like Linux is a fast kernel that can be extended with loadable modules (notably filesystems and device drivers, among others), Drizzle explicitly says “no” to building in some features, instead pushing them out of the core and into plug-ins. This separation allows Drizzle to focus on only the most essential features of a modern database kernel. In fact, it’s almost a become a joke on the Drizzle mailing list that someone will say “Make it a plugin!” when anyone questions removing functionality from the server.

At this point you may be wondering who would be crazy enough to think that MySQL, known for its speed and agility, needs to be radically re-worked. After all, it’s been the dominant open source relational database for the better part of a decade now.

The Drizzle project is headed by Brian Aker, the former director of architecture for MySQL. Aker now works in the Office of the Chief Technology Officer at Sun (soon to be Oracle) and heads up a team of developers working on Drizzle and a few other projects (see one of Aker’s early posts on Drizzle). Some of those developers are Sun employees (Eric Day, Jay Pipes, Monty Taylor, Mark Atwood, and others), while others are either volunteers or contributing to Drizzle on behalf of their employer. Toru Maesaka of Mixi is one such developer.

A lot of the Drizzle work is driven by significant changes in hardware that have occurred since widespread adoption of MySQL began. Before discussing what Drizzle is and is not, it’s important to understand a bit about the last 5-7 years of evolution in hardware and systems and the challenges those presented to MySQL users, especially those who were constantly pushing the envelope of what’s possible.

Moore’s Law Turned Sideways

The most significant change in recent hardware history is that Moore’s Law took a surprising turn. For years, developers have been able to depend on the clock speed of CPUs doubling roughly every 18 months. In other words, the code you ran in early 2001 would be more than twice as fast if you simply upgraded the CPU in your server in late 2002. Why “more than” twice as fast? Not only did clock speeds increase, changes in the architecture of CPUs made them more efficient, too: larger caches, more registers, better instruction pipelines, and so on.

This doubling trend went on for so long that Moore’s Law was practically law and something destined to continue for the foreseeable future. But then something strange happened a couple years ago. Instead of seeing 4 GHz CPUs appear to replace 3.2 GHz CPUs, Intel and AMD started pushing multi-core CPUs that ran at slower clock speeds. Effectively, the megahertz and gigahertz game had come to an end. Instead of pure “vertical” scaling, Moore’s Law had been redirected along a different axis: horizontal scaling.

At the 2009 MySQL Conference, Sun co-founder Andy Bechtolsheim delivered a keynote presentation called The Solid State Storage Revolution, which contained a chart plotting CPU clock speeds over the last 20 years or so. It illustrated this sudden change very clearly and removed any doubt about where things are headed. (Sadly, his slides are not available online).

In a sense this isn’t new. Symmetric multiprocessing (SMP) has been around for years now in the form of motherboards with two or four physically separate CPUs. But having multiple CPU cores on the same physical chip was a new approach. Intel previewed the future with the introduction of Hyper-Threadingon some Pentium 4 CPUs. The technology allowed a single CPU to run two execution threads in parallel. It’s not the same as having two physical cores on the same chip, but it was a nice boost at the time.

With Moore’s Law overturned, the new road to efficiency and performance is to design for concurrency and parallelism. Any problem that can be split into sub-problems and executed in parallel fits this new world very well. As you’ll see momentarily, there are places where MySQL is able to exploit multi-core well, but others in which it was of no help at all.

RAID and RAM

As with all things hardware, the cost of running substantial RAID arrays (6-12 disks) with battery-backed write caches has dropped substantially. That doesn’t mean that disk I/O isn’t still the single biggest bottleneck in large databases—it is. Any time your data size grows substantially beyond what can fit in RAM, I/O bottlenecks appear. But today’s “commodity” hardware lets you push that barrier out quite a long way.

Thanks to commodity 64-bit CPUs, it’s not hard to find a server than can be loaded with 64 GB or even 128 GB of memory. That alone is sufficient to keep a very large percentage of MySQL deployments from having to worry about going to disk that often. But what about those really big deployments?

The transfer rates of modern disks and their controllers is measured hundreds of megabytes per second. But that’s assuming a best case scenario: linear (sequential) reads or writes. The real killer is random disk I/O. Any time the disk head needs to move (seek), you incur a delay of several milliseconds. Event the fastest hard disks available claim average seek times in the 4 ms range. Expecting more than about 200 seeks per second is unrealistic. In fact, the rule of thumb for years has been not to expect more than about 100 I/O operations (iops) from a single spindle.

Having larger disk arrays means being able to perform a greater number of iops per second: typically something like (N/2)*100 where N is the number of disks. You must divide by two because of mirroring. In a typical setup of 12 disks, there are 6 mirrored pairs (RAID-1) and stripe (RAID-0) data across them. This is commonly referred to as RAID 1+0.

Using this model, the only way to get another 200 iops out of your array (without sacrificing data integrity) is to add two or four more disks. Like Moore’s Law, this had been true for a very long time. But just like Moore’s Law, the storage game has recently changed in a most unexpected way.

Comments on "Drizzle: Rethinking the MySQL Database Kernel"

This text is priceless. Where can I find out more?

my website – Cialius

Good day! I know this is kinda off topic but I
was wondering if you knew where I could locate a captcha plugin for my comment form?

I’m using the same blog platform as yours and I’m having trouble finding one?
Thanks a lot!

my web-site :: India generic pharmacy

Right away I am going away to do my breakfast, after having my breakfast coming over again to read other news.

Also visit my homepage – canadian pharcharmy online for ed problems

Hello there! Do you know if they make any plugins to safeguard against hackers?
I’m kinda paranoid about losing everything I’ve worked hard on. Any recommendations?

Also visit my blog post – ciallis

Can I just say what a comfort to uncover somebody
that genuinely knows what they’re talking about online.
You actually realize how to bring an issue to light and make it important.
A lot more people must look at this and understand this side of the story.
I was surprised you aren’t more popular given that you definitely possess the gift.

Here is my page – Pfizer viagra

Thanks for finally writing about > Drizzle: Rethinking the MySQL Database Kernel | Linux Magazine < Loved it!

My web site … cyalis online

What’s up all, here every one is sharing these familiarity,
therefore it’s fastidious to read this blog, and I used to pay a visit
this webpage all the time.

Also visit my website: levitra brand

With havin so much content and articles do you ever run into any issues of plagorism or copyright infringement?
My site has a lot of completely unique content I’ve either created
myself or outsourced but it seems a lot of it is popping it up all over the web without my agreement.
Do you know any methods to help prevent content
from being stolen? I’d definitely appreciate it.

Feel free to surf to my blog – Generic cialis india price

Wow, superb blog layout! How long have you been blogging for?
you made blogging look easy. The overall look of your site is magnificent, let
alone the content!

Here is my web page: where to but brand cialis without persciption

Every weekend i used to pay a quick visit this website,
as i wish for enjoyment, as this this web site conations truly nice funny data too.

Also visit my blog Buy soft sildenafil citrate overnight delivery usa pharmacy

I’d like to find out more? I’d care to find out some
additional information.

My web site; Ed cheap candean drugs

Can you tell us more about this? I’d care to find out more details.

Stop by my web site :: where to buy cialis safely without prescription

After checking out a few of the blog posts
on your web page, I honestly like your technique of writing a blog.
I book-marked it to my bookmark site list and will be checking back in the near future.
Please check out my website too and let me know what you think.

My blog post – Buy cialis without a prescription

I’m amazed, I have to admit. Rarely do I come across a blog that’s both equally educative and
interesting, and without a doubt, you have hit the nail on the head.
The problem is something which not enough men and women are speaking intelligently about.
I’m very happy that I came across this during my hunt for something relating to this.

Feel free to visit my page – Cialis generic from canada

Thank you, I’ve just been searching for information approximately this subject for ages and yours is the best I have found out so far.
But, what in regards to the bottom line? Are you positive about the
source?

My web blog: Best ed medicine

What’s up colleagues, nice piece of writing and pleasant urging commented
at this place, I am really enjoying by these.

Visit my webpage :: Canadian prescription free pharmacy

Just wish to say your article is as amazing. The clearness in your post is
just spectacular and i could assume you are an expert on this subject.
Well with your permission let me to grab your RSS feed to keep updated with forthcoming post.
Thanks a million and please carry on the gratifying
work.

My website – Viagra@canadianpahamacy

I’m not sure the place you are getting your information, but good topic.

I must spend a while studying much more or working out more.
Thank you for excellent information I was on the lookout for this info for my mission.

Look into my weblog – Canadian generic ed drugs

Hello There. I discovered your blog the use of msn. That is a very well written article.

I will be sure to bookmark it and come back to learn more of your helpful info.
Thanks for the post. I’ll certainly return.

Feel free to surf to my webpage: viagra patent

This is my first time go to see at here and i am genuinely pleassant to read everthing at one
place.

Here is my site Cheap virgra canda

Magnificent items from you, man. I’ve take into account your stuff previous to and you are just
too magnificent. I really like what you’ve acquired here, really like what you are stating and the way in which wherein you are
saying it. You’re making it enjoyable and you continue to care for to
stay it wise. I can not wait to learn far more from you.
This is actually a wonderful website.

Here is my web page Canadian pharmacy tadalafil with no prescription

Hey there! I know this is somewhat off topic but I was wondering which blog platform are
you using for this website? I’m getting tired
of WordPress because I’ve had problems with hackers and I’m looking at options for another platform.
I would be awesome if you could point me in the direction of a good platform.

Stop by my website … cialis online brand

Thanks for sharing such a good opinion, article is fastidious,
thats why i have read it entirely

My weblog Generic-pharmacyrx

I just want to tell you that I’m newbie to blogs and definitely enjoyed you’re blog site. Most likely I’m likely to bookmark your blog post . You actually come with impressive articles and reviews. Thanks for sharing with us your blog site.

It’s going to be finish of mine day, however before
end I am reading this fantastic article to increase my experience.

Look into my blog :: rx cialis

I have been exploring for a bit for any high-quality articles or blog posts in this
sort of area . Exploring in Yahoo I ultimately
stumbled upon this site. Studying this info So i am glad
to exhibit that I have an incredibly good uncanny feeling I found out just what I
needed. I such a lot certainly will make sure to don?t omit this web site and provides
it a glance on a continuing basis.

Check out my blog post – Usa no desriction cialis

I don’t know if it’s just me or if perhaps everybody else experiencing problems with your website.

It looks like some of the written text on your posts are running off the screen. Can somebody
else please comment and let me know if this is
happening to them as well? This may be a issue with my web browser because I’ve
had this happen previously. Cheers

my page Cialis 5mg costs

Amazing! Its really amazing post, I have got much clear idea regarding from this paragraph.

Feel free to visit my blog … Viagra online pharmacy free shipping

Very rapidly this website will be famous among all blog users, due to it’s good articles

Also visit my blog … canadianpharmacyshippingusa.com

Unquestionably believe that which you said. Your favorite
justification appeared to be on the internet
the easiest thing to be aware of. I say to you, I certainly get irked
while people think about worries that they plainly don’t know about.
You managed to hit the nail upon the top as well as defined out the whole thing without having side
effect , people can take a signal. Will probably be back to get more.
Thanks

Feel free to surf to my web site :: canadian ciali

At this time I am ready to do my breakfast, when having my breakfast coming again to read further news.

Look at my site :: Walmartpharmacey.com

Here are several of the web pages we advocate for our visitors.

Every weekend i used to visit this site, for the reason that i want enjoyment, since this this web site conations genuinely good funny
material too.

My blog … cheap car insurance in ny

Everything is very open with a clear description of the issues.
It was definitely informative. Your website is useful. Thank you for sharing!

Also visit my blog post – fred loya car insurance

Their variety and versatility makes them a perfect match for every taste and budget.
Ultimately, the Canada Goose ladies expedition parka is an excellent choice and will provide you
with many winters of enjoyment, pleasure and
envious admirers. She was working as the activity administrator when she decided to offer exercise
classes for babies with their parents.

Feel free to surf to my homepage cheap michael kors handbags

Please visit the web sites we follow, including this one, as it represents our picks in the web.

After looking at a handful of the blog articles on your web page, I truly like your technique of blogging.
I added it to my bookmark site list and will be checking
back in the near future. Please visit my website as well and tell
me what you think.

Feel free to surf to my weblog :: quote car insurance

Great post.

Feel free to visit my page … buy car insurance

Write more, thats all I have to say. Literally, it seems
as though you relied on the video to make your point.
You clearly know what youre talking about, why throw away
your intelligence on just posting videos to your site when you could be giving us
something enlightening to read?

my weblog what does liability car insurance cover

I loved as much as you will receive carried out right here.

The sketch is tasteful, your authored subject matter stylish.
nonetheless, you command get got an edginess over that you wish be delivering the following.
unwell unquestionably come further formerly again as
exactly the same nearly a lot often inside case you shield this increase.

my web page: red car insurance

I like the helpful information you provide in your
articles. I will bookmark your weblog and check again here
frequently. I’m quite certain I will learn plenty of new
stuff right here! Best of luck for the next!

Also visit my web-site … average monthly car insurance payment

This is very interesting, You’re a very skilled blogger. I have joined your feed and look forward to seeking more of your
great post. Also, I have shared your website in my social networks!

my webpage car insurance cheap

Howdy! Do you know if they make any plugins to assist with Search Engine Optimization? I’m trying to get my blog to rank for some targeted keywords but I’m
not seeing very good success. If you know of
any please share. Thank you!

my blog post; metlife car insurance

all the time i used to read smaller articles which as well clear their motive, and that is also happening with
this paragraph which I am reading here.

Also visit my web blog; capital one car rental insurance

Howdy! I know this is somewhat off topic but I
was wondering which blog platform are you using for this website?
I’m getting sick and tired of WordPress because I’ve had problems with hackers and I’m
looking at options for another platform. I would be great
if you could point me in the direction of a good platform.

My website :: cure car insurance

I pay a quick visit everyday some web pages and information sites to read content, except this
blog offers feature based posts.

my web-site: cheap car insurance in pa

Woah! I’m really loving the template/theme of this website.
It’s simple, yet effective. A lot of times it’s very difficult to get that “perfect balance” between superb usability and appearance.
I must say you’ve done a awesome job with this. Also,
the blog loads very quick for me on Firefox.
Superb Blog!

Also visit my web site :: car insurance massachusetts

Just wish to say your article is as surprising.
The clearness in your publish is simply cool and i could suppose you’re an expert
on this subject. Well with your permission let me to clutch your
feed to keep up to date with approaching post. Thanks a million and please continue
the gratifying work.

Also visit my website … car insurance anaheim ca

I think the admin of this web page is actually working hard for his web site,
since here every material is quality based material.

my website: nevada car insurance

What you posted made a bunch of sense. However,
think about this, suppose you were to create a killer title?
I mean, I don’t wish to tell you how to run your blog, however suppose
you added something to possibly grab people’s attention? I
mean Drizzle: Rethinking the MySQL Database Kernel | Linux Magazine is a little boring.
You might glance at Yahoo’s home page and note how they create news titles to grab viewers interested.

You might try adding a video or a picture or two to get readers excited about what
you’ve written. Just my opinion, it could make your posts a little bit more interesting.

Here is my web-site – 21st century car insurance

Leave a Reply