Comments on: Metadata Performance Exploration Part 2: XFS, JFS, ReiserFS, ext2, and Reiser4 http://www.linux-mag.com/id/7518/ Open Source, Open Standards Sat, 05 Oct 2013 13:48:18 +0000 hourly 1 http://wordpress.org/?v=3.1 By: jlauro http://www.linux-mag.com/id/7518/#comment-6959 jlauro Wed, 30 Nov -0001 00:00:00 +0000 http://www.linux-mag.com/id/7518/#comment-6959 <p>Great article with benchmark info. It\'s always good to have benchmarks completed on identical equipment.</p> <p>As a follow-up, it would be great to see how the \"large\" file systems compare. Limit it to those that support at least 100TB file systems and 10TB files with 100,000 files in a single directory (or require even bigger limits). With 2TB drives, 100TB file system is not as rare as it once was.</p> <p>Some of the options that claim to support that are unmanageable because a crash recovery is impractical because of memory requirements to complete.</p> <p>JFS is one option that scales well. Most of the better performing options for the benchmark do not scale. Not sure which other file systems do. </p> Great article with benchmark info. It\’s always good to have benchmarks completed on identical equipment.

As a follow-up, it would be great to see how the \”large\” file systems compare. Limit it to those that support at least 100TB file systems and 10TB files with 100,000 files in a single directory (or require even bigger limits). With 2TB drives, 100TB file system is not as rare as it once was.

Some of the options that claim to support that are unmanageable because a crash recovery is impractical because of memory requirements to complete.

JFS is one option that scales well. Most of the better performing options for the benchmark do not scale. Not sure which other file systems do.

]]> By: gdrouillard http://www.linux-mag.com/id/7518/#comment-6960 gdrouillard Wed, 30 Nov -0001 00:00:00 +0000 http://www.linux-mag.com/id/7518/#comment-6960 <p>What mount options did you use in xfs and ext4? </p> What mount options did you use in xfs and ext4?

]]> By: laytonjb http://www.linux-mag.com/id/7518/#comment-6961 laytonjb Wed, 30 Nov -0001 00:00:00 +0000 http://www.linux-mag.com/id/7518/#comment-6961 <p>@gdrouillard:</p> <p>The xfs mount options were the defaults.<br /> For ext4 I used the defaults except \"data=ordered\".</p> <p>Jeff </p> @gdrouillard:

The xfs mount options were the defaults.
For ext4 I used the defaults except \”data=ordered\”.

Jeff

]]> By: laytonjb http://www.linux-mag.com/id/7518/#comment-6962 laytonjb Wed, 30 Nov -0001 00:00:00 +0000 http://www.linux-mag.com/id/7518/#comment-6962 <p>@jlauro,</p> <p>I would love to test those systems - do you have access to any hardware I can use for testing?</p> <p>Thanks!</p> <p>Jeff </p> @jlauro,

I would love to test those systems – do you have access to any hardware I can use for testing?

Thanks!

Jeff

]]> By: jlauro http://www.linux-mag.com/id/7518/#comment-6963 jlauro Wed, 30 Nov -0001 00:00:00 +0000 http://www.linux-mag.com/id/7518/#comment-6963 <p>@laytonjb: Unfortunately all the systems that I have access to over 10TB are tied up running production stuff... I\'ll try to keep this in mind next time we get a new SAN or new server for D2D backup. A week or two of burn in running benchmarks is always a good idea, especially if it impacts how we leave the file system at for production... </p> @laytonjb: Unfortunately all the systems that I have access to over 10TB are tied up running production stuff… I\’ll try to keep this in mind next time we get a new SAN or new server for D2D backup. A week or two of burn in running benchmarks is always a good idea, especially if it impacts how we leave the file system at for production…

]]> By: porridge http://www.linux-mag.com/id/7518/#comment-6964 porridge Wed, 30 Nov -0001 00:00:00 +0000 http://www.linux-mag.com/id/7518/#comment-6964 <p>With this many numbers, it would be good to see them on a chart, rather than just in a table. Makes it much easier to compare. </p> With this many numbers, it would be good to see them on a chart, rather than just in a table. Makes it much easier to compare.

]]>