dcsimg

Drizzle: Rethinking the MySQL Database Kernel

Drizzle is a re-thought and re-worked version of the MySQL kernel designed specifically for high-performance, high-concurrency environments. In this exclusive article, MySQL guru Jeremy Zawodny takes an inside look at the goals and state of Drizzle development.

If you visit the Drizzle project homepage, it explains:

Drizzle is building a database optimized for cloud and [network] applications. [Drizzle] is being designed for massive concurrency on modern multi-cpu/core architectures. The code is originally derived from MySQL.

In other words, Drizzle is a re-thought and re-worked version of the MySQL kernel designed specifically for high-performance, high-concurrency environments. The goal is to make Drizzle an extensible database kernel that runs extremely fast on emerging hardware.

Much like Linux is a fast kernel that can be extended with loadable modules (notably filesystems and device drivers, among others), Drizzle explicitly says “no” to building in some features, instead pushing them out of the core and into plug-ins. This separation allows Drizzle to focus on only the most essential features of a modern database kernel. In fact, it’s almost a become a joke on the Drizzle mailing list that someone will say “Make it a plugin!” when anyone questions removing functionality from the server.

At this point you may be wondering who would be crazy enough to think that MySQL, known for its speed and agility, needs to be radically re-worked. After all, it’s been the dominant open source relational database for the better part of a decade now.

The Drizzle project is headed by Brian Aker, the former director of architecture for MySQL. Aker now works in the Office of the Chief Technology Officer at Sun (soon to be Oracle) and heads up a team of developers working on Drizzle and a few other projects (see one of Aker’s early posts on Drizzle). Some of those developers are Sun employees (Eric Day, Jay Pipes, Monty Taylor, Mark Atwood, and others), while others are either volunteers or contributing to Drizzle on behalf of their employer. Toru Maesaka of Mixi is one such developer.

A lot of the Drizzle work is driven by significant changes in hardware that have occurred since widespread adoption of MySQL began. Before discussing what Drizzle is and is not, it’s important to understand a bit about the last 5-7 years of evolution in hardware and systems and the challenges those presented to MySQL users, especially those who were constantly pushing the envelope of what’s possible.

Moore’s Law Turned Sideways

The most significant change in recent hardware history is that Moore’s Law took a surprising turn. For years, developers have been able to depend on the clock speed of CPUs doubling roughly every 18 months. In other words, the code you ran in early 2001 would be more than twice as fast if you simply upgraded the CPU in your server in late 2002. Why “more than” twice as fast? Not only did clock speeds increase, changes in the architecture of CPUs made them more efficient, too: larger caches, more registers, better instruction pipelines, and so on.

This doubling trend went on for so long that Moore’s Law was practically law and something destined to continue for the foreseeable future. But then something strange happened a couple years ago. Instead of seeing 4 GHz CPUs appear to replace 3.2 GHz CPUs, Intel and AMD started pushing multi-core CPUs that ran at slower clock speeds. Effectively, the megahertz and gigahertz game had come to an end. Instead of pure “vertical” scaling, Moore’s Law had been redirected along a different axis: horizontal scaling.

At the 2009 MySQL Conference, Sun co-founder Andy Bechtolsheim delivered a keynote presentation called The Solid State Storage Revolution, which contained a chart plotting CPU clock speeds over the last 20 years or so. It illustrated this sudden change very clearly and removed any doubt about where things are headed. (Sadly, his slides are not available online).

In a sense this isn’t new. Symmetric multiprocessing (SMP) has been around for years now in the form of motherboards with two or four physically separate CPUs. But having multiple CPU cores on the same physical chip was a new approach. Intel previewed the future with the introduction of Hyper-Threadingon some Pentium 4 CPUs. The technology allowed a single CPU to run two execution threads in parallel. It’s not the same as having two physical cores on the same chip, but it was a nice boost at the time.

With Moore’s Law overturned, the new road to efficiency and performance is to design for concurrency and parallelism. Any problem that can be split into sub-problems and executed in parallel fits this new world very well. As you’ll see momentarily, there are places where MySQL is able to exploit multi-core well, but others in which it was of no help at all.

RAID and RAM

As with all things hardware, the cost of running substantial RAID arrays (6-12 disks) with battery-backed write caches has dropped substantially. That doesn’t mean that disk I/O isn’t still the single biggest bottleneck in large databases—it is. Any time your data size grows substantially beyond what can fit in RAM, I/O bottlenecks appear. But today’s “commodity” hardware lets you push that barrier out quite a long way.

Thanks to commodity 64-bit CPUs, it’s not hard to find a server than can be loaded with 64 GB or even 128 GB of memory. That alone is sufficient to keep a very large percentage of MySQL deployments from having to worry about going to disk that often. But what about those really big deployments?

The transfer rates of modern disks and their controllers is measured hundreds of megabytes per second. But that’s assuming a best case scenario: linear (sequential) reads or writes. The real killer is random disk I/O. Any time the disk head needs to move (seek), you incur a delay of several milliseconds. Event the fastest hard disks available claim average seek times in the 4 ms range. Expecting more than about 200 seeks per second is unrealistic. In fact, the rule of thumb for years has been not to expect more than about 100 I/O operations (iops) from a single spindle.

Having larger disk arrays means being able to perform a greater number of iops per second: typically something like (N/2)*100 where N is the number of disks. You must divide by two because of mirroring. In a typical setup of 12 disks, there are 6 mirrored pairs (RAID-1) and stripe (RAID-0) data across them. This is commonly referred to as RAID 1+0.

Using this model, the only way to get another 200 iops out of your array (without sacrificing data integrity) is to add two or four more disks. Like Moore’s Law, this had been true for a very long time. But just like Moore’s Law, the storage game has recently changed in a most unexpected way.

Comments on "Drizzle: Rethinking the MySQL Database Kernel"

You should be a part of a contest for one of the finest blogs on the web.

I am going to recommend this web site!

Feel free to surf to my website lower car insurance

Hello, its pleasant article about media print, we all be aware of
media is a wonderful source of information.

my blog: nevada car insurance

Have you ever considered writing an ebook or guest authoring on other websites?

I have a blog centered on the same subjects you discuss and
would really like to have you share some stories/information. I know my subscribers would enjoy your
work. If you’re even remotely interested, feel free
to shoot me an email.

Feel free to visit my web site :: enterprise rent a car insurance

Hello! I realize this is kind of off-topic but I had to ask.
Does building a well-established blog like yours
take a large amount of work? I am completely new to writing a blog however I do write in my journal
daily. I’d like to start a blog so I can easily share my own experience and thoughts online.
Please let me know if you have any suggestions or tips for new aspiring
blog owners. Appreciate it!

Feel free to surf to my webpage pip car insurance

Write more, thats all I have to say. Literally,
it seems as though you relied on the video to
make your point. You obviously know what youre talking about, why waste your intelligence
on just posting videos to your weblog when you could be giving
us something enlightening to read?

Also visit my webpage … aaa car insurance quotes

Pretty! This was a really wonderful post. Thank you for providing this information.

Also visit my webpage … cheap car insurance quote

That is really fascinating, You’re an overly skilled blogger.
I’ve joined your feed and look forward to searching for
more of your fantastic post. Additionally, I have shared your web site in my social networks

My homepage: car insurance companies near me

I have been browsing online greater than three hours as of late,
but I by no means discovered any interesting article like
yours. It’s pretty value enough for me. In my view,
if all website owners and bloggers made excellent content as you did, the
net will probably be much more useful than ever before.

Also visit my web site: best car insurance for young adults

Somebody essentially help to make significantly articles I might state.
This is the very first time I frequented your web page and so far?
I surprised with the analysis you made to make this particular submit extraordinary.
Excellent process!

my weblog :: cheap car insurance in texas

Wonderful article! This is the type of information that are supposed to be shared
around the net. Shame on Google for now not positioning
this put up higher! Come on over and consult with my web
site . Thank you =)

my web-site; average price of car insurance

Link exchange is nothing else however it is just placing the
other person’s webpage link on your page at appropriate place and other person will also
do similar in support of you.

Feel free to visit my blog; liability insurance car

With havin so much written content do you ever run into
any issues of plagorism or copyright infringement? My site has a
lot of completely unique content I’ve either created myself or outsourced
but it seems a lot of it is popping it up all over the internet without my
permission. Do you know any methods to help prevent content from being ripped off?
I’d definitely appreciate it.

my page: college student car insurance

I simply want to tell you that I am just all new to blogging and truly liked you’re web page. Almost certainly I’m likely to bookmark your blog post . You really come with awesome well written articles. Bless you for revealing your web page.

Good website right here! Furthermore your web blog loads upwards quickly! Exactly what number have you been the use of? Can one get a affiliate url on your own host? I’d prefer my website filled as rapidly when you haha Good website right here! Furthermore your web blog loads upwards quickly! Exactly what number have you been the use of? Can one get a affiliate url on your own host? I’d prefer my website filled as rapidly when you haha

I’m curious to find out what blog system you’re utilizing?
I’m having some minor security issues with my latest blog and I
would like to find something more safe. Do you have any solutions?

Thanks for sharing your info. I really appreciate your efforts and I am waiting for your next write ups thanks once
again.

I’m not that much of a internet reader to be honest but your sites really nice, keep it up!
I’ll go ahead and bookmark your website to come back later on. Many thanks

Take a look at my page :: ig

I am curious to find out what blog platform you have been utilizing?
I’m experiencing some small security issues with my latest site and
I would like to find something more secure. Do you have any suggestions?

Ikuti Kontes SEO PelangiQQ berhadiah total sampai 50 juta rupiah untuk 20 orang pemenang

Keyword :
BandarQ | BandarQ Online | Agen BandarQ | Domino99 | Agen Domino | AduQ Online Terbaik

untuk informasi lebih lanjut silakan kunjungi link di bawah:

Kontes SEO PelangiQQ

DominoQQ Online

PelangiQQ.com BandarQ | BandarQ Online | Agen BandarQ | Domino99 | Agen Domino | AduQ Online Terbaik

Pusat Game Domino

Judi Sabung Ayam

Judi BandarQ

It is the best time to make some plans for the future and it’s time
to be happy. I’ve read this post and if I could I desire to suggest you
few interesting things or suggestions. Perhaps you could write next articles referring
to this article. I want to read more things about it!

Also visit my homepage … prada bags outlet

Hi there to all, how is all, I think every one is getting mofe from this site, and your views are nice iin favor of new visitors.

Also visit my blog :: how to have natural clear vision

I just want to say I am just beginner to weblog and certainly loved this website. More than likely I’m likely to bookmark your site . You certainly come with amazing articles and reviews. Thanks a lot for sharing your web-site.

Always a major fan of linking to bloggers that I like but really don’t get a lot of link love from.

Thanks for the good writeup. It actually was a enjoyment account it.

Look advanced to more brought agreeable from you! By the way,
how can we communicate?

my web blog – buy cialis canada

The time to read or go to the content or web sites we have linked to beneath.

Every once in a whilst we decide on blogs that we read. Listed beneath are the latest sites that we decide on.

I cannot thank you enough for the post. Awesome.

you’re truly a good webmaster. The web site loading velocity is incredible.
It seems that you are doing any distinctive trick. Also, The contents are masterwork.
you have performed a great activity on this subject!

You’ll discover Prada block off the greeting cards throughout modest person envelopes considering the Prada
custom logo at the front end. These allurements packed in this mall call for maximum number of Bali flights annually.

Your hair is one of your greatest assets, when it comes to your overall appearance.

Feel free to surf to my webpage :: cheap prada bags

Yet, each glob-trotting experience is not only about fun and excitement.
From its humble beginnings, the shoe made history when it
was designed for the 1936 Olympics. It goes without saying that animal products such
as leather are not going to appear here (even without considering the disturbing environmental
impact of the tanning process and glues used for example).

Have a look at my blog post; cheap giuseppe zanotti shoes

I’m amazed, I must say. Seldom do I encounter a blog that’s both
equally educative and interesting, and let me tell you, you’ve hit the nail on the head.
The problem is something not enough people are speaking intelligently about.
I am very happy I stumbled across this in my search for something relating to this.

I don’t care about this, now i’m earning average 5000$ a
month. There is tricky way i found on the web.

If you want to learn it too, simply type in google: Riesling’s
strategy

Timely delivery: Timings of services should be appropriate and there should be
no transport delays. Leather shoes normally allow air to circulate (although
beware of leather shoes that are lined with a plastic
non-breathable material) but they can also cause
the foot to sweat. The most important take away from these two studies is that PEMFs might prove useful as a non-invasive, additional treatment to
be combined with other common anti-cancer therapies.

Here is my blog post – cheap jordans

May I simply just say what a relief to find an individual who genuinely understands
what they’re discussing online. You certainly know how to bring
an issue to light and make it important. A lot more people have to check
this out and understand this side of your story.

It’s surprising you are not more popular since you most certainly possess the gift.

I’m no longer positive the place you’re getting your info, but great topic.
I must spend some time studying more or understanding
more. Thanks for wonderful information I was on the lookout for
this info for my mission.

I just want to say I’m beginner to blogging and site-building and seriously loved this website. Almost certainly I’m planning to bookmark your site . You certainly have impressive articles. Regards for revealing your web page.

Please check out the internet sites we stick to, like this one, as it represents our picks in the web.

Always a significant fan of linking to bloggers that I appreciate but really don’t get a lot of link really like from.

The information talked about inside the article are several of the most beneficial available.

Whether it ended with the removal of things to protest for, the move away
from psychedelic drugs as the hit of choice or the disenfranchisement with the
excessive hedonism that typified the latter parts of the movement it.
These harmonics always present to varying degrees within all notes, and their proportions
help to give sounds their unique color or tone. It depends on how we perceived sounds and music providing
a basic scale from.

Quality articles is the main to be a focus for the viewers to visit the web page, that’s what this web
page is providing.

Also visit my weblog – Jeff Flanzer

nanoo (Jackson)
nanoo (Jackson)
nanoo, Jackson,
nanoo – Jackson -
nanoo (Jackson)
nanoo – Jackson,

Why visitors still use to read news papers when in this technological world all is presented on web?

Yes! Finally someone writes about ig.

You actually make it seem so easy with your presentation but I find
this topic to be actually something that I think I would never
understand. It seems too complicated and extremely
broad for me. I am looking forward for your next post, I’ll try to get the
hang of it!

I just want to say I am all new to blogs and honestly liked your website. Very likely I’m planning to bookmark your blog . You definitely come with good well written articles. Many thanks for sharing your blog site.

hello!,I really like your writing very a lot! share we keep
up a correspondence extra approximately your post on AOL?
I require an expert in this house to solve my problem. Maybe that’s
you! Looking forward to see you.

Who knows, maybe Tate Music Group stepped their game up after dealing with my cousin Asekor Glay.
Constant dialogue through these platforms is bound to not just positively influence your popularity but
also generate greater sales. Make sure you check on whether or not the music or subscription service you’re
paying for has specific rules regarding DRM.

An impressive share! I’ve just forwarded this onto a colleague who has been conducting a
little homework on this. And he in fact ordered me dinner simply
because I found it for him… lol. So allow me to reword this….
Thanks for the meal!! But yeah, thanks for spending time to discuss this matter here on your
web page.

Leave a Reply