IWETHEY v. 0.3.0 | TODO
1,095 registered users | 0 active users | 0 LpH | Statistics
Login | Create New User
IWETHEY Banner

Welcome to IWETHEY!

IWETHEY Home / IWETHEY Board / Unix Forum / Re: What I'd do.
Post #175,899
by deSitter
Picture of deSitter
9/23/04 10:50:13 AM
Reply
New Re: What I'd do.
I heard rsync blows chunks performance-wise since it's read-file/write-file one at a time.

Just checked, not an option in any case (on this system). I have sudo but must be judicious. Installing rsync might get me escorted out. (Hell, viewing IWETHEY might get me escorted out.)
-drl
Post #175,905
by ben_tilly
9/23/04 11:05:45 AM
Reply
New Nope
rsync handles multiple files at a time and is very fast as long as you turn the right options on and off. This can take research to figure out. For instance I usually don't use -a because that implies -I, which causes it to expensively do an MD5 on every single file. I'm happy knowing that the files have the same size and modification time even though theoretically that could be wrong.

rsync is also clearly The Right solution if you're going to have to resynchronize the data.

However when I sit down with it I always need a while to figure out what exact combination of flags I really want to use this time.

Cheers,
Ben
About the use of language: it is impossible to sharpen a pencil with a blunt axe. It is equally vain to try to do it with ten blunt axes instead. -- Edsger W. Dijkstra
     tar vs. cpio - (deSitter) - (43) - Sept. 23, 2004, 09:34:54 AM EDT
         I'd use tar. - (static) - (2) - Sept. 23, 2004, 10:25:44 AM EDT
             Re: I'd use tar. - (deSitter) - (1) - Sept. 23, 2004, 10:44:56 AM EDT
                 I've done it on Linux., - (pwhysall) - Sept. 23, 2004, 10:46:57 AM EDT
         dd - (pwhysall) - Sept. 23, 2004, 10:44:18 AM EDT
         What I'd do. - (folkert) - (2) - Sept. 23, 2004, 10:48:01 AM EDT
             Re: What I'd do. - (deSitter) - (1) - Sept. 23, 2004, 10:50:13 AM EDT
                 Nope - (ben_tilly) - Sept. 23, 2004, 11:05:45 AM EDT
         What I'd be inclined to do - (ben_tilly) - (35) - Sept. 23, 2004, 11:01:05 AM EDT
             What he said. -NT - (static) - Sept. 23, 2004, 10:09:07 PM EDT
             Re: What I'd be inclined to do - (deSitter) - (33) - Sept. 24, 2004, 04:19:06 AM EDT
                 The CPU overhead is likely less than the network overhead. - (pwhysall) - (30) - Sept. 24, 2004, 07:04:00 AM EDT
                     Especially text... -NT - (Another Scott) - (4) - Sept. 24, 2004, 10:31:45 AM EDT
                         Not a given - (deSitter) - (3) - Sept. 24, 2004, 10:46:03 AM EDT
                             Even PKZip on a 286 running DOS could fly through text files - (Another Scott) - (1) - Sept. 24, 2004, 11:04:49 AM EDT
                                 Re: Even PKZip on a 286 running DOS could fly - (deSitter) - Sept. 24, 2004, 11:08:01 AM EDT
                             Doesn't matter - (ben_tilly) - Sept. 24, 2004, 11:07:23 AM EDT
                     In fact... - (ben_tilly) - (1) - Sept. 24, 2004, 11:22:34 AM EDT
                         Re: In fact... - (deSitter) - Sept. 24, 2004, 11:47:50 AM EDT
                     Your pipe is too small then - (broomberg) - (22) - Sept. 24, 2004, 05:46:13 PM EDT
                         Try different compression quality? - (ben_tilly) - (18) - Sept. 24, 2004, 06:54:01 PM EDT
                             Try? We do not try. We do. - (broomberg) - (17) - Sept. 25, 2004, 08:13:15 PM EDT
                                 An advantage of gzip is that it's easy to detect errors. - (Another Scott) - (1) - Sept. 25, 2004, 08:25:35 PM EDT
                                     If you MUST... - (broomberg) - Sept. 25, 2004, 08:44:07 PM EDT
                                 Thanks for the figures - (ben_tilly) - Sept. 26, 2004, 01:56:09 AM EDT
                                 Thanks, and questions. - (pwhysall) - Sept. 26, 2004, 02:00:08 AM EDT
                                 lzop vs. gzip - (pwhysall) - (12) - Sept. 26, 2004, 02:34:36 AM EDT
                                     Interesting - (broomberg) - (11) - Sept. 26, 2004, 07:31:51 AM EDT
                                         Seeing you tease Peter makes me aware that... - (ben_tilly) - (1) - Sept. 27, 2004, 11:58:22 AM EDT
                                             In person - (broomberg) - Sept. 27, 2004, 12:41:09 PM EDT
                                         What are happening to the 450s? - (folkert) - (3) - Sept. 27, 2004, 12:28:46 PM EDT
                                             Dunno. Ask Dave. - (broomberg) - (2) - Sept. 27, 2004, 12:39:33 PM EDT
                                                 I'm sorry Dave, but Dave's friend Dave says Dave's at... - (ben_tilly) - Sept. 27, 2004, 01:05:25 PM EDT
                                                 Thanks. -NT - (folkert) - Sept. 28, 2004, 02:19:24 PM EDT
                                         Ah, but in MY house... - (pwhysall) - (4) - Sept. 28, 2004, 03:32:35 AM EDT
                                             Not spam - (broomberg) - (3) - Sept. 28, 2004, 07:33:49 PM EDT
                                                 Still spam; just spam on dead trees. - (CRConrad) - (2) - Sept. 29, 2004, 01:43:02 AM EDT
                                                     "admirable or honourable" - Yup - (broomberg) - (1) - Sept. 29, 2004, 08:19:15 AM EDT
                                                         The fulfillment (sic) third, maybe. The rest? Nope. - (CRConrad) - Sept. 29, 2004, 01:54:13 PM EDT
                         That was my intuitive suspicion -NT - (deSitter) - (2) - Sept. 25, 2004, 06:22:42 PM EDT
                             And as usual - (broomberg) - (1) - Sept. 25, 2004, 08:15:23 PM EDT
                                 Well sure - (deSitter) - Sept. 26, 2004, 12:52:31 PM EDT
                 Beware spaces in filenames - (Arkadiy) - (1) - Sept. 24, 2004, 01:37:14 PM EDT
                     Already checked :) -NT - (deSitter) - Sept. 24, 2004, 03:11:47 PM EDT

No, Mr. Bond! I expect you to die!
116 ms