IWETHEY v. 0.3.0 | TODO
1,095 registered users | 1 active user | 0 LpH | Statistics
Login | Create New User
IWETHEY Banner

Welcome to IWETHEY!

New Well what has me curious about it...
If you abuse your filesystem as a database, you are likely to have a ton of small files somewhere. And some big files elsewhere. I understand that ReiserFS is supposed to do a very good job of making tradeoffs between these two situations dynamically.

Ext3 is just ext2 with some extra journaling meta-data stored. Put a few thousand files in a directory, and it slows down.

I haven't yet had time and resources to give this a try, but this feature interests me.

Cheers,
Ben
New Large directories: very fast performance w/ reiserfs
Reiserfs definitely screams relative to ext2fs on larg directory listings. Example: the IWE forums archive consists of single-file posts in one directory, with 124,657 files. Doing time \\ls | wc -l on the directory reads in just under four seconds. Read time under ext2 was significantly longer, many seconds, possibly a minute or more. Turning off directory sorting (-U flag), read is reduced to under a second (0.791, 0.772, 0.856, 0.780, in repeated trials).

The difference: reiserfs stores directories as hash tables. In ext2fs, they're serial lists. It took literally hours to unpack the archive I'd received from Craig under ext2.

Note that there are still issues with large directories, but rieserfs will deal with them.

Note also that I'm using an escaped 'ls' to disable colored listing, which requires reading the first few (512 IIRC) bytes of a file to determine its magic. With "--color=auto" and directory sorting, the listing takes 2:32.097s to run.
--
Karsten M. Self [link|mailto:kmself@ix.netcom.com|kmself@ix.netcom.com]

What part of "gestalt" don't you understand?
     Reiserfs -- comments? - (slugbug) - (21)
         What spam? - (admin) - (4)
             *smile* - (imric) - (2)
                 Re: *smile* - (slugbug) - (1)
                     Reiserf - (boxley)
             Re: What spam? - (slugbug)
         Hmmm. Might be a boring topic. - (imric)
         Send Nick a note... - (bepatient)
         Not used it myself... - (static) - (3)
             Neither have I - (Steve Lowe) - (1)
                 Thanks for the link! -NT - (slugbug)
             Re: Not used it myself... - (slugbug)
         I thought Andy Grygus had some comments about it... - (Another Scott) - (2)
             Ditto! - (a6l6e6x)
             This was brought up . . - (Andrew Grygus)
         Re: Reiserfs -- comments? - (addison)
         Experiences, comments -- largely positive. - (kmself) - (1)
             Good stuff, Karsten! Thanks. -NT - (a6l6e6x)
         The pressing question for me - (pwhysall) - (3)
             Good one - (kmself)
             Well what has me curious about it... - (ben_tilly) - (1)
                 Large directories: very fast performance w/ reiserfs - (kmself)

Like many lawyers, he's overly fond of argument, even when in agreement. Not that anyone here would be into that...
72 ms