Especially text...

IWETHEY v. 0.3.0 | TODO

1,095 registered users | 0 active users | 0 LpH | Statistics
Login | Create New User

Welcome to IWETHEY!

Post #176,126 by Another Scott 9/24/04 10:31:45 AM Reply	Especially text...
Post #176,133 by deSitter 9/24/04 10:46:03 AM Reply	Not a given The files are hyarge, and there are lewge numbers of them. -drl
Post #176,146 by Another Scott 9/24/04 11:04:49 AM Reply	Even PKZip on a 286 running DOS could fly through text files Archivers are very good at compressing text, and do it very quickly. The algorithms are well known and well optimized. Compression generally makes more sense than transmitting large files. Sometimes it's essential. See, e.g. [link\|http://www.sc2000.org/techpapr/papers/pap.pap254.pdf\|this .pdf] of a paper on near-interactive transferring of computational fluid dynamics simulation images over a WAN. Cheers, Scott.
Post #176,151 by deSitter 9/24/04 11:08:01 AM Reply	Re: Even PKZip on a 286 running DOS could fly Well the idea here is just to directly stream data from file to file. I still don't see that a bunch of parallel copyinouts are going to benefit from compression/decompression, given that this must involve creating something temporary on disk, or using a buttload of memory. -drl
Post #176,150 by ben_tilly 9/24/04 11:07:23 AM Reply	Doesn't matter gzip works fine with infinite streams of data since it only keeps track of local information about the data that it is compressing. So have no worries about using it on large files. Cheers, Ben About the use of language: it is impossible to sharpen a pencil with a blunt axe. It is equally vain to try to do it with ten blunt axes instead. -- Edsger W. Dijkstra

tar vs. cpio - (deSitter) - (43) - Sept. 23, 2004, 09:34:54 AM EDT

I'd use tar. - (static) - (2) - Sept. 23, 2004, 10:25:44 AM EDT

Re: I'd use tar. - (deSitter) - (1) - Sept. 23, 2004, 10:44:56 AM EDT

I've done it on Linux., - (pwhysall) - Sept. 23, 2004, 10:46:57 AM EDT

dd - (pwhysall) - Sept. 23, 2004, 10:44:18 AM EDT

What I'd do. - (folkert) - (2) - Sept. 23, 2004, 10:48:01 AM EDT

Re: What I'd do. - (deSitter) - (1) - Sept. 23, 2004, 10:50:13 AM EDT

Nope - (ben_tilly) - Sept. 23, 2004, 11:05:45 AM EDT

What I'd be inclined to do - (ben_tilly) - (35) - Sept. 23, 2004, 11:01:05 AM EDT

What he said. -NT - (static) - Sept. 23, 2004, 10:09:07 PM EDT

Re: What I'd be inclined to do - (deSitter) - (33) - Sept. 24, 2004, 04:19:06 AM EDT

The CPU overhead is likely less than the network overhead. - (pwhysall) - (30) - Sept. 24, 2004, 07:04:00 AM EDT

Especially text... -NT - (Another Scott) - (4) - Sept. 24, 2004, 10:31:45 AM EDT

Not a given - (deSitter) - (3) - Sept. 24, 2004, 10:46:03 AM EDT

Even PKZip on a 286 running DOS could fly through text files - (Another Scott) - (1) - Sept. 24, 2004, 11:04:49 AM EDT

Re: Even PKZip on a 286 running DOS could fly - (deSitter) - Sept. 24, 2004, 11:08:01 AM EDT

Doesn't matter - (ben_tilly) - Sept. 24, 2004, 11:07:23 AM EDT

In fact... - (ben_tilly) - (1) - Sept. 24, 2004, 11:22:34 AM EDT

Re: In fact... - (deSitter) - Sept. 24, 2004, 11:47:50 AM EDT

Your pipe is too small then - (broomberg) - (22) - Sept. 24, 2004, 05:46:13 PM EDT

Try different compression quality? - (ben_tilly) - (18) - Sept. 24, 2004, 06:54:01 PM EDT

Try? We do not try. We do. - (broomberg) - (17) - Sept. 25, 2004, 08:13:15 PM EDT

An advantage of gzip is that it's easy to detect errors. - (Another Scott) - (1) - Sept. 25, 2004, 08:25:35 PM EDT

If you MUST... - (broomberg) - Sept. 25, 2004, 08:44:07 PM EDT

Thanks for the figures - (ben_tilly) - Sept. 26, 2004, 01:56:09 AM EDT

Thanks, and questions. - (pwhysall) - Sept. 26, 2004, 02:00:08 AM EDT

lzop vs. gzip - (pwhysall) - (12) - Sept. 26, 2004, 02:34:36 AM EDT

Interesting - (broomberg) - (11) - Sept. 26, 2004, 07:31:51 AM EDT

Seeing you tease Peter makes me aware that... - (ben_tilly) - (1) - Sept. 27, 2004, 11:58:22 AM EDT

In person - (broomberg) - Sept. 27, 2004, 12:41:09 PM EDT

What are happening to the 450s? - (folkert) - (3) - Sept. 27, 2004, 12:28:46 PM EDT

Dunno. Ask Dave. - (broomberg) - (2) - Sept. 27, 2004, 12:39:33 PM EDT

I'm sorry Dave, but Dave's friend Dave says Dave's at... - (ben_tilly) - Sept. 27, 2004, 01:05:25 PM EDT

Thanks. -NT - (folkert) - Sept. 28, 2004, 02:19:24 PM EDT

Ah, but in MY house... - (pwhysall) - (4) - Sept. 28, 2004, 03:32:35 AM EDT

Not spam - (broomberg) - (3) - Sept. 28, 2004, 07:33:49 PM EDT

Still spam; just spam on dead trees. - (CRConrad) - (2) - Sept. 29, 2004, 01:43:02 AM EDT

"admirable or honourable" - Yup - (broomberg) - (1) - Sept. 29, 2004, 08:19:15 AM EDT

The fulfillment (sic) third, maybe. The rest? Nope. - (CRConrad) - Sept. 29, 2004, 01:54:13 PM EDT

That was my intuitive suspicion -NT - (deSitter) - (2) - Sept. 25, 2004, 06:22:42 PM EDT

And as usual - (broomberg) - (1) - Sept. 25, 2004, 08:15:23 PM EDT

Well sure - (deSitter) - Sept. 26, 2004, 12:52:31 PM EDT

Beware spaces in filenames - (Arkadiy) - (1) - Sept. 24, 2004, 01:37:14 PM EDT

Already checked :) -NT - (deSitter) - Sept. 24, 2004, 03:11:47 PM EDT

Powered by medium-dudgeon.
350 ms