Kernels 2.6.35 and 2.6.36: Storage Updates

Two kernel releases have gone by since we last checked in with the check-ins. While the storage related changes are seemingly minimal, it's always good to review what changed; you might be surprised.


Recently, I have spent some time reviewing Linux kernels from a storage perspective; starting with 2.6.30 (actually going back into the 2.6.2x series) and ending with the 2.6.34 kernel. That article was published on June 8 of this year – just a short time ago. In the meantime, the pace of kernel development has continued and as of the writing of this article the merge window for the 2.6.37 kernel has just closed signaling the beginning of the great bug hunt before the release of the 2.6.37 kernel. So now seems like a good time to go over the 2.6.35 and 2.6.36 kernels to review what changes have happened that affect the Linux storage world.


One of the best sources of information about Linux kernel versions is kernelnewbies.org”. It has a very nice writeup of the higher level kernel changes but the writeup can be a little terse. However, they can be very useful as a starting point. In particular, let’s start with the 2.6.35 highlights as a starting point for a discussion about the storage changes in the 2.6.35 kernel.

One of the first items listed in the kernel newbies 2.6.35 review is about changes to one of the favorite Linux file systems, btrfs. In 2.6.35, btrfs added support for direct I/O. Direct I/O is a method that allows the data to go from the application buffers directly to the storage devices (hence the term “direct”). This bypasses all of the caching and other IO techniques in the VFS (e.g. read-ahead, write coalescence). For some workloads Direct I/O can result in improved performance and reduced CPU usage on the host. A classical example of a workload that can benefit from Direct I/O is a database workload.

The second updated file system that was highlighted is xfs. XFS has been around a fairly long time and was originally ported to Linux by SGI (the “old” SGI) a while ago. For many years xfs was the file system of choice for high performance but it is also known to have less than stellar metadata performance. However, thanks to Redhat and other developers, xfs development has been revived and there are a number of new features/capabilities in today’s xfs (i.e. “it’s not your father’s xfs”).

In the 2.6.35 kernel, a new journaling technique was added to xfs that is somewhat based on ext3 and reiserfs. This journal approach collects asynchronous transactions in memory. This reduces the I/O bandwidth on the log by several orders of magnitude, allowing much better metadata performance for heavy metadata workloads. In addition, the I/O bandwidth used for the log decreases by orders of magnitude. This patch didn’t change the log format on the disk but only changed the in-memory potion of the logging. However, this journal mode, called “delayed logging”, is still experimental, but you can test it using a mount option: “-o delaylog”. If you are using xfs and have heavy metadata workloads, you might want to consider trying this logging option in a test environment.

The kernel newbies review listed the btrfs and xfs changes as fairly major, but there were some other changes to other file systems that are fairly important as well. To make things easier, I’ve create a list of the file system and the significant changes.

  • Squashfs: xattr (extended file attributes) support was added. This allows squashfs to retain xattr values associated with data and it also allows squashfs to be better combined (“unioned”) with other file systems so that a single data tree can seemingly be both read and write.
  • Ext2: The remaining pieces of the BKL (Big Kernel Lock) were removed from ext2 in 2.6.35. The BKL was originally used to get SMP (Symmetric Multi-Processing) capability into the kernel fairly quickly but it also reduced the scalability of the kernel as well as imposing some performance penalties. These changes mean that the last remnants of the BKL in ext2 have been removed from the Linux kernel. While you may scoff at people still focusing on ext2, it is still widely used and, believe it or not, it has good performance.
  • Ext4: The big change with ext4 in 2.6.35 was the addition of a check for a good block group before loading “buddy pages”. This change speeds up allocations particularly for the case where partitions are relatively full.
  • NILFS: This log-structured file system added a subtle change in 2.6.35. It changed the default of “errors” mount option to “remount-ro” mode. Previously when nilfs encountered an error it would allow operations to continue, possible further causing errors. With this change, the default behavior in nilfs is to mount the file system as read-only (“ro”) so that further damage is minimized.
  • OCFS2: In 2.6.35 there were several changes to OCFS2 (one of the under appreciated file systems in Linux). The first change was to implement allocation reservations, which can greatly reduce fragmentation because allocations for a specific file can be done much more sequentially (this has implications for performance as well). Several smaller changes were made as well and they are listed below (from the kernel newbies list)
    • The “punch-hole” code was further optimized to speed up some rare operations.
    • A dis-contiguous block group was created to improve some types of allocations. It marks an incompatible bit which makes it a forward-compatible change.
    • The no file interruption (nointr) mount option was made default.

There were also some additions to the block I/O layer for the kernel (blkio) that impact storage. These changes can be important because they affect how I/O operations are done within the kernel including monitoring of I/O operations. The first set of changes are the addition of some statistics that can help with monitoring. These statistics are:

  • io_service_time
  • io_wait_time
  • io_serviced
  • io_service_bytes
  • io_merged
  • io_queued
  • avg_queue_size

The first four statistics are accumulated per operation type (I/O operation) helping us to distinguish between read and write operations and sync and async I/O operations. The fifth statistic, io_merged, is mostly used for debugging. The last two statistics are also primarily used for debugging as well. They keep statistics of the queue depth of the cgroup (a part of the I/O controller). The authors, Jens Axboe and Divyesh Shah, state that they can be used for debugging user I/O problems.

A few more patches were added to gather the per-cgroup statistics which can be used for debugging problems as well. One of the more important patches was to add a “reset_stats” interface so that all of these statistics can be reset (great for debugging).

Overall, these kernel changes may not result in obvious changes to Linux storage, but actually they are fairly important. We’re seeing the continued development of btrfs, albeit somewhat slower than we like. This could possibly point to the stabilization of btrfs but people are still asking for the additional features. Similarly we’re seeing changes to ext4 that capture more “corner cases” which can affect performance.

Finally, one change that is important whether you might not think so, is the addition of the statistics to the I/O controller. These statistics can greatly help developers when debugging problems or when users encounter problems. Scheduling I/O operations can be very complex and greatly depend upon the details of the workload so it’s almost impossible a priori to know how workloads will interact with the I/O scheduler. Being able to understand what the I/O scheduler is actually doing is important in finding and debugging problems or for improving performance (remember that bad performance is considered by many to be a “bug”).


Comments on "Kernels 2.6.35 and 2.6.36: Storage Updates"

‘Instead of the traditional 6% closing costs, the platform slashes commissions down to below 2%, so if you bought a house for $2 million in New
York, you’re saving $80,000. I was starting to get frustrated
with the other agents. They feel they have control over their investments.

Most of the things an affiliate marketer needs for
his business are already on the web. Actually, while lots of possess master’s certifications, a number
of extremely effective experts keep merely a bachelors degree.
A particular physician believes that many doctors have grown jealous.

Fantastic blog post.Thanks Again. Will read on…

At 7 Health, you’ll be able to see the same physician every time you visit our clinic ,and you’ll pay
an office visit fee of just $7 each time.
Evidence showed Barson, Juarez and Shakbazyan billed
Medicare for procedures that did not occur on 429 patients in just two
months. A particular physician believes that many doctors have grown jealous.

We provide complete solutions for each company.
Our objective is your satisfaction with the fallout of our job so that
your site can be a elemnt of your laborer. Our web designer club can design everything of the corporate delivery is accessible quickly
and at an cheap cost. We even have kit for web design.

Long walks are a great way to relieve stress and anxiety in dogs
- especially when separated from their families. The difficulty with amazing pick up strains is that they’re
hardly ever profitable in real-life social scenarios. People are destined
to failure prior to starting when they have not practical end targets.

The absolute best way to qualify is to drive carefully at all times.
Where do you come up with the difference to payoff your auto loan. The clients
can address this issue by avoiding driving while intoxicated, maybe not using cell phones while driving, and obeying
the traffic lights and signals.

You can certainly see your skills in the work you write.
The sector hopes for more passionate writers like you who are not afraid to mention how they believe.
Always follow your heart.

Below you will locate the link to some sites that we think you ought to visit.

For hottest information you have to pay a quick visit internet and on the web I found this site as a most excellent web page
for most recent updates.

However the result of the test is only as good as the exactness with which the test was performed.
Actually, while lots of possess master’s certifications, a number of extremely
effective experts keep merely a bachelors degree.
Couple all of this with i – Pads, Wi-Fi’s and laptops and a doctor has everything he needs.

Hi my family member! I want to say that this post is amazing, great written and
include approximately all significant infos. I would like to see more posts like this .

Also visit my blog take network marketing

Our option to utilize miami heat gorras strapback our problem-solving skills give you innovative solutions allowing our society to Nike Air Max Men Sale earn advancements previously thought impossible. Thinking beyond your box is just what separates us from various other life forms even if you email address particulars are Asics Running Shoes Men n’t always with the bette

How is CD burning or advancement of audio CD from mp zapatos jordan para hombres 3 files done? Cheap Gucci Shoes Men To make it simple,zapatos jordan para hombres, you because the user must compile your mp3 playlist consisting of the mp3 files or music on which you decide. Then,Cheap Gucci S Chanel Jewelry UK hoes Men, you are likely to keep music files by way of the

If your physician suggests a treatment, inquire about your options, and ask
why he or she is recommending this particular treatment for you.
Yes, your guessed it, it’s easier to get a new patient than to get another employee of the same quality.
The potent herbs of Pilesgon capsule help in the formation of new blood to prevent occurrence of blood loss induced anemia which is one of the most
common problems associated with piles.

Now,www.blackfrid http://www.blackfridayzapatos.com ayzapatos.com, do you believe there have been oth Cheap Nike Free Women Sale er barriers to conquer?You can easlily reminisce and express that obvious a no-brainer for Joseph, but from where he stood,Cheap Nike Free Women Sale, t had been a huge ba gafas de sol ray ban hombre rrier to simply accept a wife merely already pregnant and it al

Como sustituto para buscar más información sobre en línea,Nike Football S Nike Football Shoes Sale hoes Sale, que hicieron lo que vino naturalment zapatos jordan para hombres e: que demandaron. No lo hicieron darse cuenta y todavía estar no entiendo cuidar un Napster 10 o más clones se surjan para conseguir nuevos objetos.Numerosos características puede

Here are some hyperlinks to web-sites that we link to due to the fact we think they are really worth visiting.

Fantastic items from you, man. I have keep in mind your stuff previous to and you’re just extremely great.
I really like what you have acquired right here, certainly like what
you’re stating and the best way by which you assert it.
You make it entertaining and you continue to take care of to stay it sensible.
I cant wait to learn much more from you. This is really a great web site.

First of all, you’ll find nothing incorrect allong
with supportive tto consume. There are many individuals who
dwll to nibble on along with there are many which try to eat to call home.
Though the complete human race does not belong to possibly of the groups.

There are a few whom appreciate greaat meal,
however his or her day-to-day lives depend on tthe foodstuff.
Bar meal Cheshire is beloved iin most regions and also if yyou are a
new foostuff partner, you have to knowledge the kind of meal you obtain here.
Visit a family members pub Cheshire and benefit from the finest food in addiion to drinks using your
total spouse and children. Absolutely nothing is drastically wrong using caring you
can eat. There are several those who reside to enjoy as well as there
are some whom take in to live. Thouugh the total human race will not belong to
possibly of the classes. There are some exactly who love
grea foods, although their particular lifestyles rely on the
foodstuff. Nightclub foods Cheshire can be adored in numerous regions
as well as in case you are a fod fan, you should experience the level of meal you get inn this article.
Check outt a spouse and children club Cheshire aand you’ll take pleasure in thee very best
food in addition to beverages along with your total
family members. Your message nightclub iss generally connected with older people.
The greatest cafes in the united states are ogten entertained
by means of sports lovers who adore to seee his or her clubs struggle this out there while they deink alcohol as well as beer and so on. However it’s not
at alll necessary that a little ones can not go to the club.
Sure, there are a feww discos that you wouldn’t
want to get your son or daughter to. Yet a fanily
group nightclub Cheshire seriously isn’t among most of these institutions.
The actual bar fod Cheshire in this particular pub can be so fantastkc which every person reaches appreciate somehow
or one other. This specific household club Cheshire affords tthe best inside British meal.

Youu can find many people saying oof which United kingdom meal isn’t competitive with the meals that is organized in the differdent nations like Italy along with The world and others.
Moreover, your say associated with Indian native curries possesses further improved your colour pallette on the Brritish isles
foodies. Neverdtheless the reality is off which English meal has its very own great flavor.

Consumed typical British meal and you also cannot help however practically riff your fingers.
Yes, it matters which tthe cocinro is extremely good,
but when yoou go to a good option for pub food Cheshire,
you will probably have the particular chef beimg presents itself their particular cooking proficiency.
Witthin this househnold pub Chesshire you will get every thing you need to try too eat along with ingest.
Within the products segment you’ve the best possible cask ales, British
as well as imported lager, cider in addition to an extensive
bunch of wine. Thhe meals selrction can be extensive and you have the choicee from
which to chhoose this eting place menu, this
2-for-1 fokod list, your bar food selection as well as the Wednesday menus.

The actual mouth-watering pots and panns arre generally sure to make you
feel greater than pleased. If you aree searching for having this specific tavrrn meals Cheshire, visit the website and also havve a look at the food list.

All the info that you’ll require iis given within tthe web page such as
the range to help phone to create your booking. About weekdays
you might reach the particular casfe and locate a spot, although throughout
weekends, it really is foolhardy looking to fiund the place with out a booking.
Whatever the case, it?s a good idea forr you to book before hand irrespective of whejever you are.
Find out more on the net to trial exceptional tavern food Cheshire.
As of this household nightclub Cheshire you’ll have the many foods
that make you delighted. The values usually are very well within your budget, though the foodstuff is merely outt of your earth.

My web page streaming bokep artis

sac longchamp
pliage porte monnaie raisin pas cher Sac Longchamp Pliage Paris Sulley
Longchamp universitaire vêtements universitaire monstre
sac homme longchamp
sac longchamp pas cher
sac longchamp bandouliere

I cling on to listening to the news update talk about receiving boundless online grant applications so I have been looking around for the finest site to get one. Could you tell me please, where could i acquire some?

We prefer to honor many other world-wide-web internet sites around the web, even though they aren?t linked to us, by linking to them. Below are some webpages really worth checking out.

For starters, there is nothing ijcorrect using adoring to
consume. There aare some folks who are living to cconsume and there are several whom
take to reside in. Nevertheless the entire human race won’t are part of sometimes of such categories.
There aree a few exactrly who appreciate excellent foods, yet their own day-to-day lives be based upon the meals.
Pub foodstuff Cheshire can be cherished in numerous parts of
the country and for anyone who is some sort of foods fan, you muswt experience the kind of foodstuff you will get right here.
Visit a household tavern Cheshire and you’ll experience the
very best meal as well as drinks along wwith your total family members.
You’ll find nothing incorrect together wjth warm to consume.
There are several folks who are living to consume as well as there arre several whom consume
tto live on. However thee overqll human race will not ffit in with often of the groups.
There are several that adore excellent meal, nevertheless
the life depend on thier food. Cluub meals Cheshire iis cherished in lots of regions and also if you’re the meals partner, you need to expertise the level of meal you obtain below.

Visit a household pub Cheshire and you mayy benefit from the ideal meal along with beverages
using your entire spouse and children. Your message club is often linked to older people.
The biggest bars in the united kingdom tend
to be entertained by sporting activities addicts that
like to view their ownn clubs fight this out and aboiut as the drink drauht beeer and lager and
the like. Yet it’s not essental that your particular youngsters can not go to the club.

Sure, there are many pubs that you wouldn’t choose to get young kids
to be abble to. Nevertheless a family group club Cheshire seriously isn’t
between these types of companies. The nightlub food Cheshire in this
particular bar can be so amazing which every person actually reaches delight in somehow as well
aas another. This particular spouse and children club Cheshire provides the best in Unitged kingdom
foods. Yoou can find many individuals saying of
which British isles meal is just not aas goood as the
foodstuff whic is well prepared frlm the some othedr places such as England andd also The nation and others.
Furthermore, your influx of Indian curries provides further improved the
colour pallette with the British isles foodies. Yet the truth is inn which United kingdom meal possesses a good preference.
You consume common British isles food and also you are
not ablee too assist howefer pretty much coat your
own fingertips. Yes, this things that this chief cook is extremely good, but once
you pay a visit to the best plzce with regard to bar foods Cheshire, you could expect your cooking being over the rest ttheir cooking expertise.
With this loved ones bar Cheshire you have every thing you would like to
take in as well as drink. From the products
section you’ve thee best cask beers, United kingdom and also imported
lager, cider and also an extensive assortment off wine beverages.
The food food selection is also intensive and also you have
the choice available your bistro food selection, this
2-for-1 food selection, this pub menu and also the Wednesday menu.
Yourr mouth-watering pots and pans are usually certain to generate you are feeling
more than delighted. In the event you are intefested in possessing this particular baar meal Cheshire, visit the internet site along with have a look at the
particular menu. All the information that you might want can be offered in the website suuch as variety to be able to phine
tto make your current booking. About weekdays youu might arrive at
yor eating place and discover an area, nevertheless in the course of weekends, it can be foolhardy trying
to find ann areea with no booking. In aany case, it feels rightt to be able to book in advance regardless oof when you go.
Gather more information online in order to trjal exceptional nightclub meals
Cheshire. Only at that family members pub Cheshire you can have
hundreds oof foodstuffs that will make an individual satisfied.
The costs tdnd to be nicely within your budget, but the foods is simply outside the world.

I simply had to appreciate you again. I’m not certain the things that I would have sorted out without the entire techniques revealed by you on such industry. It was before a real hard case in my circumstances, nevertheless taking a look at the specialized way you resolved that forced me to jump for happiness. I will be happier for the support and thus trust you realize what a great job you happen to be getting into instructing men and women by way of your webblog. Most probably you’ve never encountered any of us.

Really informative blog.Really looking forward to read more. Keep writing.

Here is a good Weblog You might Locate Intriguing that we encourage you to visit.

An intriguing discussion is worth comment. There’s no doubt
that that you ought to publish more about this
subject, it might not be a taboo matter but typically
people don’t speak about such issues. To
the next! All the best!!

Good post. I will be experiencing many of these
issues as well..

As I grew older, and had no thought who was producing films and whether or not or
not participation was voluntary, porn misplaced it’s attraction.

Hello my family member! I wish to say that this
article is amazing, nice written and come with almost all vital infos.
I’d like to peer more posts like this .

May I just say what a comfort to discover a person that genuinely knows what they are discussing
over the internet. You certainly realize how to bring a problem to light and make it important.
More people need to look at this and understand this side of the story.
I can’t believe you are not more popular since you certainly
possess the gift.

Right here is the right website for anybody who hopes
to find out about this topic. You understand a whole lot its almost tough to argue with you (not that I personally would want to…HaHa).
You certainly put a new spin on a subject which has been discussed for a long time.

Wonderful stuff, just great!

Please take a look at the internet sites we adhere to, like this a single, because it represents our picks in the web.

To begin with, there’s nofhing wrong along with caring you can eat.
There are several people that are living to nibble on along
with there are some who take to reside in.
Nevertheless thee verall people will not fit in with sometimes
of these categories. There are a few whom enjoy excellent meals, but their day-to-day lives rely
on the meals. Club foods Cheshire is cherished in lots of regions along with should you be a new foodstuff lover, you need to practical knowledge the amount of food
you receive right here. Visit a spouse and children bar Cheshire and yoou will take avantage of the very best meal in addition to refreshments using your
total household. Absolutely nothing iss wrong using adoring to nible on. There arre many those who live you can eat and there are many exactly who
take in to live. Eveen soo thee whole human race won’t remain in either of the classes.
There are numerous whom enjoy good foodstuff, although their owwn life be determined bby the food.
Bar meals Cheshire is actuallly liked in numerous areas along with if you’re a neww foods fan, you will need to knowledge thee amont of foodsguff you will get here.
Visit a family nightclub Cheshire and youu wijll enjoy the
finest foodstuff and also products with your overall family.
Yoour message nightclub is frequently linked to parents.
The best discfos near you are often entertained byy means of sporting
activities lovvers which love to see their particular clubs struggle thius out andd about as thgey drink
light beer along with lager annd many others. But it’s
not at all necessary that the young children cannot search for a club.
Indeed, there are several cafeds that you simpky would
not choose to consider your son or daughteer
in order to. Althoughh a fsmily bar Cheshire isn’t betweenn
these kibd of establishments. The partticular club food
Chshire in this puub is so amazing that all eople
reaches appreciate for some reason as well as the other.
This particular family members tavern Cheshire
affords the gredatest in Uk food. You’ll discover
many individuals saying of which English foodstuff isn’t competitive with the foodstuff
that is prepared inside some other nations including France
along with The nation yet others. Additionally, tthe
actual increase associated with Native indian curries has even more changed yopur colour pallette from the Uk foodies.
But the reality is of which Uk meal has its excellent tastes.
Consumed common English food and youu also are not
able to support however almost coat your own fingers.
Sure, that concerns how the cook is fantastic, however whenerver
yyou check out the absolute right place pertaining to pub food Cheshire,you can anticipate
the particular chef to get presents itself his or her cooking food
proficiency. On this spouse and children club Cheshite you will get everything you intend too tame in as well as take in.Insidse refreshments ssegment you
might have the optimum cask beers, Uk along with brought
in beer, cider and a wide-ranging bunch of bottles of wine.
The food selection iss also intensive therefore you have the choice to choose
frm thhe actual cafe menu, the 2-for-1 menus, your clubhouse
menus as well as the Sunday menus. The actual mouth-watering dishes tend to bee limited to generate you sense more than happy.

In the event that yoou are looking at acquiring this kind of nightclub
meal Cheshire, look at the web site in addition to take a look at the selection. All the information that you’ll requirre is given from the
web page such as range to help call up to make your current booking.

On weekdays you might go to the actual bistro and locate a
place, but in the course of weekends, iit really is foolhardy trying to find a spot with out a reservation. Regardless, it seems sehsible in order to
book upfront regardless of when you’re. Finnd out more oon the internet in order too trial
outstanding nightclub meals Cheshire. As of
this family members tavern Cheshire you might have
those food items that make anyone content. The costs
tend to bbe well within your budget, butt the foodstuff is merely out of your world.

Feel free to visit my website; video bokep indo

I’m impressed, I must say. Rarely do I come across a blog that’s
both educative and entertaining, and without a doubt, you’ve
hit the nail on the head. The problem is something not
enough people are speaking intelligently about.
I am very happy that I came across this during my hunt for something concerning this.

Excellent post. I was checking continuously this blog and I’m impressed!

Extremely helpful info particularly the last part :) I care for such information much.
I was looking for this particular info for a long time.

Thank you and best of luck.

Everyone loves what you guys are usually up too. This type of clever work and coverage!

Keep up the terrific works guys I’ve incorporated you
guys to my personal blogroll.

Pretty section of content. I simply stumbled upon your website and in accession capital to claim that I get actually enjoyed account your weblog posts.
Any way I’ll be subscribing to your augment or even I achievement you access constantly quickly.

You really make it appear so easy with your presentation however I find this topic to be actually one thing which I believe I would by no means understand. It kind of feels too complicated and very broad for me. I’m looking forward in your subsequent post, I will attempt to get the grasp of it!

Hiya! I know this is kinda off topic nevertheless I’d figured I’d ask.
Would you be interested in exchanging links or maybe guest writing a
blog article or vice-versa? My blog covers a lot of the same subjects as
yours and I think we could greatly benefit from each other.

If you’re interested feel free to shoot me an e-mail.
I look forward to hearing from you! Awesome blog by the

Outstanding quest there. What occurred after? Thanks!

Hola! I’ve been reading your site for some time now and finally got the courage to go ahead and give you a shout
out from Lubbock Tx! Just wanted to mention keep up the excellent work!

My brother recommended I would possibly like this web site.
He was totally right. This post truly made my day.
You cann’t consider simply how a lot time I had spent for this info!

I think the admin of this site is really working hard
for his site, because here every stuff is quality based information.

Its like you learn my thoughts! You seem to know a lot approximately this, such as you wrote the guide in it or
something. I feel that you simply could do with some p.c.
to drive the message house a little bit, however other than that,
this is wonderful blog. A fantastic read. I will certainly be back.

magnificent issues altogether, you simply received
a logo new reader. What could you suggest in regards to your put up
that you simply made a few days in the past? Any certain?

What’s up, everything is going fine here and ofcourse every one
is sharing information, that’s truly excellent, keep up writing.

Leave a Reply