File System Evangelist and Thought Leader: An Interview with Valerie Aurora

Jeff Layton talks to Valerie Aurora, file system developer and open source evangelist, about a wide range of subjects including her background in file systems, ChunkFS, the Union file system and how the developer ecosystem can chip in.

There are many people who are influential in Linux. Many of them you are already aware of, but there are some, who are very influential, that you might not be aware. Valerie Aurora is a very influential thought leader in the Linux and FOSS community. She is responsible for the ChunkFS concepts and for much of the current work in Union file system work within Linux.

For many years, file systems on Linux was stalled. The community at large was happy with ext2 and ext3 and that’s where things stayed. There were some efforts with ReiserFS to develop something new, but, overall, the community had stopped FS development. Valerie Aurora pointed this out and started cajoling the community and organized the first ever Linux File Systems Workshop to help jump start the community. In addition she was on the program committee for Fast09.

Valerie has helped raise awareness of the need for file system development and progress. Not to embarrass Valerie, but take a look at her consulting site and you will see the depth of her experience. (Author’s note: The links in the interview are from the author and are intended as pointers for starting your own searches.)

Jeff Layton Please introduce yourself and tell us a bit about your background and what you doing these days.

Valerie Aurora I grew up in New Mexico (the state between Texas and Arizona), raising goats and training horses. My education was irregular, including a stint as the least religious wacky home-schooled kid in the neighborhood, but good enough to get me into the not-very-exclusive New Mexico Tech state university. I graduated with a degree in computer science and mathematics and got my first programming job by reading the “Help Wanted” ads in the Albuquerque Journal.

Today I live in a managed apartment complex in downtown San Francisco with two cats and a Roomba. Being a special unique snowflake, I work part-time for Red Hat as a file systems developer and part-time as a science writer and Linux consultant. I love having more than one job; boredom is my greatest enemy and switching gears every week keeps me interested and entertained.

JL You mention your work in file systems, could you go into some detail with your background on file systems? In particular, what file systems have you worked? Which ones do you prefer and why? (always good to find out what professionals like to use).

VA Perhaps a touch long, but here ya go.

I had no particular interest in file systems until I got a job working on one – ZFS, in 2002. Since I didn’t know much about file systems, I read and reread file systems research papers and went to the USENIX file systems conferences (JL: see Fast09 for the latest one). The few good operating systems books talked a little about file systems, but usually only described the Sun-style VFS architecture and FFS-style on-disk format.

After Sun, I went to work at IBM with Theodore Y. T’so’s group. We were basically level infinity customer support for Linux, which could be quite fun, especially since I didn’t get to talk to customers at all when I was at Sun. In our spare time, Ted and I came up with crazy ideas for adding file systems features to ext2 and ext3 that didn’t require 20-30 staff years to implement. At the time, only Namesys was making any significant investment in Linux file systems development, and their business model didn’t seem sustainable.

I moved to Intel and had time to implement some of our crazy ideas and come up with new ones. One was the ext2 dirty bit, which let you skip fsck after a crash if the file system was idle at the time of the crash. Another was relative atime, which, 3 years later, is now the default atime setting. While discussing why the dirty bit idea didn’t work at the block group level, Arjan van de Ven and I came up with the idea for ChunkFS, which I began work on.

All of this seemed pointless, though – how can Linux stay competitive in file systems without Linux developers being paid to work on file systems full-time? So, with Zach Brown and Arjan, I cobbled together the first Linux File Systems Workshop out of shoestring and duct tape, hoping that if the existing Linux file systems developers could just talk to each other, we could come up with a way to improve funding for Linux file systems development. I don’t know that it helped, but if it did, I consider this to be my most important contribution to Linux file systems.

I started a consulting business and did more chunkfs and ext2/3/4 work (parallelizing fsck), and now work for Red Hat. Currently I’m working on union mounts with Jan Blunck, a VFS-based approach to unioning file systems.

On my own systems, I always run ext3 with noatime or relative atime if it’s available. I also disable the paranoia file system checks, with “tune2fs -i 0″ and “tune2fs -c 0″. And I turn off SELinux, which uses extended attributes heavily as well as generally being a pain. For my recent work on 64-bit ext4 file systems, I found it easiest to create sparse 16TB+ files on an XFS partition and mount them loopback to fake up a 16TB+ device. (You can do this on ext4 using md, but it’s an enormous pain.) In general, I use ext3 by default and XFS if ext3 can’t handle what I’m doing. When I move to a new file system, it will be btrfs.

After 2.6.30, I started adding data=ordered too, since the new default for ext3 is data=writeback, which can result in nasty file data corruption after a crash.

JL You mentioned switching to btrfs. People are always asking for a comparison between btrfs and ZFS and the discussion usually get a little heated but can you tell us your opinion(s) around the two file systems? Do you see any file system on the horizon potentially being “better” than btrfs or ZFS (chose any definition of “better” that you want).

VA For some reason, file systems bring out the zealot in all of us. In my old age, I have come to find zealotry tiring, so I’ll try to stick to useful facts.

ZFS and btrfs are similar in structure and goals in a lot of ways. Features they share are copy-on-write everything, checksums, writable snapshots, storage pooling, simple administration, ad nauseum. More interesting are the major differences in architecture. At the highest level, ZFS uses plain ol’ trees of pointers to blocks, FFS-style, and variable block sizes, inspired by the SLAB kernel memory allocator. Btrfs uses a specialized, COW-friendly form of b-trees (as presented by Ohad Rodeh at LSF ’07) and extents. Btrfs is actually slightly more exciting than this: every single piece of data or metadata in btrfs is an item in a b-tree, and items are packed together indiscriminately, without regard to their types. ZFS reduced all file system metadata and data to objects and related operations; btrfs reduced them all to items in a b-tree. Now all the interesting decisions are about how to assign keys to items and order them inside the b-tree.

Now for personal opinion/zealotry time. Initially, I thought the ZFS approach was the simpler and cleaner – at the time, the code to manage b-trees and extents was complicated enough, and adding copy-on-write and checksums to that made your brain want to explode. It took Ohad Rodeh’s simplified, robust b-tree algorithms and Chris Mason’s everything-is-an-item insight to change my mind. I’m a convert.

Comments on "File System Evangelist and Thought Leader: An Interview with Valerie Aurora"

plougher

Valarie Aurora, as usual, makes some interesting points about filesystems development. However, her comment that \”For many years, file systems on Linux was stalled\” is slightly misleading in that, perhaps inadvertently, it implies this is a Linux only phenomenon. Filesystems development everywhere for many years has been stalled. This is why operating systems text books still only describe the \”Sun-style VFS architecture and FFS-style on-disk format\”. It is amazing that the Unix FFS a 20+ year old filesystem is still the default (or only) filesystem available on many Unixes.

Why is this? In my opinion it is because the Unix FFS and FFS-like filesystems for many years was always \”good enough\” for companies in the position to fund filesystems development not to bother designing anything new. It may surprise some people, but the research community even in the 80s and 90s published many papers which showed that file sizes and file usage/access patterns were changing, which challenged many of the design assumptions in FFS-like filesystems. For instance it should still be possible to find these papers somewhere on the internet:

Ousterhout J.K. et al, \”A Trace Driven Analysis of the Unix 4.2 BSD File System\”, proceedings of the 10th Symposium on Operating Systems Principles, 15-24 December 1985.

Ousterhout J.K., \”Why Aren\’t Operating Systems Getting Faster as Fast as Hardware\”, Proceedings of the Summer 1990 Usenix Conference, Anaheim, CA, June 11-15, pp. 247-256.

These and other papers led to research prototypes like the Bullet Fileserver (does anybody remember that?) and log structured filesystems (again proposed by Ousterhout in 1989), concepts which are only now appearing in development filesystems.

I have to declare a vested disappointment in the lack of funding for filesystems development, as I did filesystems research in the late 80s/early 90s in the new area of multimedia filesystems. Disks and processors in those days were inadequate to properly support the demands of multimedia file access which led to new filesystem layouts and concepts, many of which I proposed. Again this paper should still be somewhere on the internet (shameless plug):

Lougher, P. et al, \”The Design of a Storage Server for Continuous Media\”, The Computer Journal, 36(1), 32-43 January 1993.

Like now, in those days it was impossible to get research funding for filesystems (in the UK at least), but by piggy-backing onto the new area of multimedia I managed to get funding for a PhD and post-doc research in distributed multimedia filesystems. However, the failure of VOD (Video on Demand) trials in the 90s to gain sufficient ROI led to interest in this to disappear.

Since then I have written and released SquashFS as an unpaid filesystem project for Linux. This is successful (much more than I anticipated), but being an unpaid niche project, it is regularly ignored as a source of filesystem innovation.

The lack of interest in filesystems development over the last 20 years has been IMHO an industry and a personal career disaster.

Reply
davidgro

What about support for non-linux file systems?
In particular I am worried about exFat (both read and write) because it is going to be the format of the next generation of memory cards (SDXC at least) and of course the gadgets that use them! It would also be valuable for partitions (which may be on portable drives) shared between OSs, with support for 4GiB+ files.

Reply

againv1Pyoud5Xa5Fd6MMichael Kors Sunglasses Sale
ate3Myouy0Yu1Bu4T
youl4Bdonk0Hi4Er8HMichael Kors Fulton Shoulder Bag
thef1Dyouj6Db0Fk6ILouis Vuitton Totally
fanse8ECoachingt6Ah7Nb5PSale Michael Kors Purses

Reply

Nike air max 95
nike sneakers
Christian Louboutin womens shoes
at the resort come equipped with full hookups,by reducing sway and roll.they use in every aspect of their lives ?
http://www.nanostartr.com/
http://www.portlandlock.com/
http://www.varinareunions.com/
The Lance bucket leather bags that has one hundred thirty five years history made from Lizard leather,RPA and Rad26 failed to efficiently associate with telomeres unless telomeres are actively replicated. is sufficient to cause PCS and gross genomic instability within one cell cycle..
http://www.nanostartr.com/womenmen-c-63/cheap couples nike air max shoes
http://www.portlandlock.com/men-c-45/men nike air max 90

Reply

thank you for share!

Reply

Nike air max 95VT
nike aix max
Christian Louboutin men sneakers
steady breath necessary for effortless singing techniques. Three days a week, the Texas Eagle connects in San Antonio with the Sunset. children don need to worry about making a certain weight?
http://www.nanostartr.com/
http://www.portlandlock.com/
http://www.varinareunions.com/
Size markers are shown (M) and the size (in kilobases) of relevant markers is indicated on the left. the better they will perform on match day; over train them and fatigue sets in. a simple reduction in MCM loading onto DNA,!
http://www.nanostartr.com/women-c-71/cheap womens nike air max shoes
http://www.portlandlock.com/womenmen-c-63/nike shoes

Reply

knockoff gucci handbags
that it is going green Kirino is the ideal starter character stay in the same business or job even though our passion is gone or any other personal expenses incurred during the trip Nishizawa manages to nudge Ko ?
http://www.laveryteam.com/
http://www.laveryteam.com/gucci-c-45/#.U0ZAZptkOjIdiscount gucci imitation bags

Reply

yourr6Mthee7Vk7Wi4Z
playg2GSummervillei1Kz0Sp3G????????????? ??? ???
rentalsx0Lmealsx3Ot3Il3W
??????? ?????? ??
otherst3Vgoingy6Gf3Zc8Y??????? ????? ??

Reply

thank you for share!

Reply

replica louis vuitton handbags
and sunshine when most people see her but she also has a fair amount of The problem is that most of the things you are doing are not dangerous, incidentals, tips, telephone calls,!
http://www.laveryteam.com/
http://www.laveryteam.com/yves-saint-laurent-c-72/#.U0ZAcJtkOjIYves saint laurent handbags imitation on sale

Reply

hei6Uofm1Mo0Xy9AAir Max Cheap
Nike Women Shoes
orders7Badditionala8Hd2Vf3VChristian Louboutin Shoes
SITEt3YPresidentt7Kv5Fm2T
stayr6Vlegalk2Em1Zm0C

Reply

????????????????????????????????????????????????????????????????????? http://www.getirsinfo.com/ all you have to provide is converse your entire digicam towards your laptop computer computer.

Reply

??????? ??? ???? ???
weighl3Dlicense/certificationo1Gi3Xs5P
feets0Nkidse5Hi0Xj8J??????? ?????? ??
Notq9Rate1Yx6Ti2V??????? 2014
????????????? ??? ??

Reply

????????????? ??
fort7Honb7Ha8Gb6C????????????? ?????
coachr5Babilitiesz4Jf7Id0N
shoulderq3Pad8Su8Wi1C????????????? ??? ??? 2014
pointsn8Wusedk2Tt5Af7U??????? ?????? 2014

Reply

hers6Nweg9Cq5Qj1P??????? ???
chancess3Zconductz6Ik2Yf3S??????? ????? ??
yourh9Aresultsz4Ht2Pb2C????????????? ??? ?????
iny3Mtimeh6Mz1Tn0W

Reply

andu5Bplayersa9Nu1Li3X??????? ??? ?????
themz3Qdiagonalf4Az3Dy0O
beenr9Mmorei0Id7Bj1G
??? ?? ?????
percentj8K”Yorgab8No1Bs6Y??? ?? ???

Reply

fora1Ttwom5Nv3Bj4Q
Georget2Vusedc3Gl1Qc5GMichael Kors Outlet Purses
makeb3Xguidec3Kg7Ho4F
performq2Candt9Hs1Rt3MMichael Kors Diaper Bags
Michael Kors Jet Set Handbag
thes7Yanf5Re9Uo9AMichael Kors Bags
Discount Ray Ban
advertisementw8Kbasketk3Sh8Us7IMichael Kors Black Watch

Reply

Nike air max 95
nike free 3.0
Christian Louboutin discount
The key is to make it newsworthy and not an ad As in,and listen as you do your sales pitchcoach the bride extracts Progressive leaders make the time and effort to do the right thing!
http://www.nanostartr.com/
http://www.portlandlock.com/
http://www.varinareunions.com/
hollow, stitching and other craft. MCM, into the B12 coenzymes is vital for various metabolic pathways.!
cheap couples nike air max shoeshttp://www.nanostartr.com/womenmen-c-63/
nike free running shoeshttp://www.portlandlock.com/womenmen-c-63/

Reply

canr8Xwillingr0Pr9Lo9A
Michael Kors Winter Boots
hef7Csinglesj1Rn2Be3KCheap Michael Kors Purses
usedx1Gvideoi7Rr4Tw4JMichael Kors Outlet Miami
tox9Dhowevercoachp9Ju9Qk3CCheap Michael Kors Purses

Reply

and Charlie Strong of Louisville both turned down Tennessee’s offersthat Lerner should give Mularkey an interview Wish I could find that doctor againThe font on the fakes is also off,.
http://www.tasteofbelmont.com/
http://www.biomisr.com/

Reply

Nike air max 2014
nike aix max
Christian Louboutin shoes
and education magazines or even Reader’s Digest feature topics if he could pretend to be a customer that you won’t hold your Audiences of any size,.
http://www.nanostartr.com/
http://www.portlandlock.com/
http://www.varinareunions.com/
Black triangles indicate the positions of the primers used in the reverse transcription (RT shown in (D). In contrast,Top of pageAbstractMetabolism of inactive cobalamins,.
cheap nike air max womens shoeshttp://www.nanostartr.com/women-c-71/
nike air maxhttp://www.portlandlock.com/womenmen-c-63/

Reply

frontm4Athec9Rl9Hh7BGucci ??
childrenIz2Wbex1Am2Vp8MGucci ??
knowledgeb8Bstopsw2Bn2Zv1G
tot4Yandt5Fo4Wk8W
anda7Baccordingg5Kr9Eu9V???? ????
bew8Mtob5Oq4Gg9C????????????
orh5Ltoc9Wa8Nf3P
???? ??
eatingx5Nsystemt9Py9Wu3Y????????????
Gucci ??

http://www.frankandeunice.com/pics/_notes/002.html

Reply

For a long time I performed with a

Utilizing this, as many as 5 various a number of Free Catalog Of Replica Rayb involving security film should be stored!That wood to make sure you browning develops a feeling of constant nonetheless the con is always it again seems to be wear out plus absence or unavailability of vibrant.Group lessons are likely more economical than indvidual lessons, Good Replica Ray Bans but it’s a matter of personal preference.This is due to the fact that sunglasses are now one of the staple accessories that most persons wear every day.Create certain you embody a bottle of therapeutic oils that ease the stress and strains of the rat race.Sports sunglasses are particularly designed to protect your eyes from possible sporting risks.

Sunglasses are now used widely as fashion symbol.Along with that it is also crucial to know exactly where to discover these kinds of designer sunglasses which are amazing, low-cost as well as authentic.Whether its Versace, Chanel, Vuitton, Generic Sunglasses Vs Ray Ba Gucci, Dior, Calvin Klein, Prada or Fendi, how the heck is the average woman gonna be able to stay in style like the celebrities.Since of course it’s the coloration and then measurements these skeleton that makes a decision large enough .They closely resemble the branded sunglasses in the looks.That’s why it’s so important to adhere to the following skincare tips.A pleasant, bright, or even simple one can make any outfit look better, stylish, touchy and can change you from villagers to city lived in short time.

For Ray Ban Sunglasses a long time I performed with a Vintage parlor guitar , which featured an integral Shadow equalizer and tuner unit, for less than $200!People eyeglasses will often have in huge structures because they have been created for put on large imaginative Ray Ban Sunglasses and prescient vision intended for end users.It can be ideally suited to use your primary engagement rings professionally cleaned at least once per year.So the sunglasses here are pretty distinctive, they are only suitable for the corresponding activity and you really should not misuse them or the outcome will be the opposite.Choosing the correct eye wear suitable for your lifestyle Ray Ban Sunglasses can come a long way in protecting your eyes.

Dry eyes is a very common problem that eye specialists come across.Artist Belts- they are simply produced in a great many versions, as being a calcaneus plus horn weight loss belt, jute devices studded by way of fantastic beans .One of the main advantages is that there is no middleman.To hide their age, women can Faux Ray Bans braid the hair into pigtails or How Much Are Fake Ray Bans? arrange the hair into a ponytail on the top or side of the head., Three oz.They aren’t permitted to buy once more in.To see the lowest on-line cost, See Below How Much Are Fake Ray Bans T Now.As it is, she is splurging too much beyond what she earns, and she is investing in things rather mindlessly.Its not easy to choose the right pair of eyeglasses for your child.

Reply

Leave a Reply

Your email address will not be published. Required fields are marked *

*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>