Multiple CPU supported compression (zip, rar...) utility?

Message

kskim91 · #1 Post by **kskim91** » Sun Apr 16, 2006 4:03 pm

I was wondering with the introduction of dual processor to the main stream, are there any multiprocessor supported compression utilities out there. I've searched a bit and haven't been able to find one.

I'm always compressing and decompressing large ascii data files and get really bored waiting for them to finish...

davidspalding · #2 Post by **davidspalding** » Sun Apr 16, 2006 10:09 pm

They must be REALLY large if they're taking a long time to compress on a contemporary system. I find that WinZIP does a lickety-split job on a 1.8 ghz with 1.5 GB of RAM.

christopher_wolf · #3 Post by **christopher_wolf** » Sun Apr 16, 2006 11:21 pm

I have seen the embedded WinZip utility in Windows XP choke on some *huge* files. Past a gig or so. WinRAR does a pretty good job as does WinZip.

kskim91 · #4 Post by **kskim91** » Sun Apr 16, 2006 11:21 pm

I keep a lot of different versions of my data, a bit of a data rat pack. Also, as I am running things on a server which has limited workspace, I am constantly zipping them up and unzipping them. My main data sets are around 2Gb and some of the raw data is aroung 5Gb. I should really cut them up into more managable sizes and run them parrallel, but then I would have more files to worry about.

Just wished that 2GB DDR2 modules don't cost as much as a whole new laptop, then I would just get a large external usb hdd and run things on my thinkpad. With the number people sharing the server, sometimes it gets so slow.

kskim91 · #5 Post by **kskim91** » Sun Apr 16, 2006 11:25 pm

christopher_wolf wrote:I have seen the embedded WinZip utility in Windows XP choke on some *huge* files. Past a gig or so. WinRAR does a pretty good job as does WinZip.

I think Winxp winzip utility has a filesize limit and can't handle really large data.

I would love to use WinRar, especially with the data recovery options that it has, but we don't have a license for it on the server.
I've lost one or two zipped datasets due to corruptions which could not be repaired, luckily I had backups.

davidspalding · #6 Post by **davidspalding** » Mon Apr 17, 2006 10:10 pm

christopher_wolf wrote:I have seen the embedded WinZip utility in Windows XP choke on some *huge* files.

The whut? Oh, something I don't even use. I stick with what works. Registered version of WinZIP, I'm happy. WinRAR .. didn't use it much, didn't like it. (Can't remember why.)

DIGITALgimpus · #7 Post by **DIGITALgimpus** » Tue Apr 18, 2006 9:27 am

I've been a fan of 7zip for quite some time. Very fast, and good compression options. 7zip format is nice, but most often use zip, since it's most compatible with others.

Not to mention it's open source, and completely free.

davidspalding · #8 Post by **davidspalding** » Tue Apr 18, 2006 5:17 pm

Our Visual Studio server uses that. I like the 7zip utility ... lean, quick, simple. The way I like my shareware, and my women (he said, ducking from the inevitable slap from a feminist, which I am also actually).

kskim91 · #9 Post by **kskim91** » Tue Apr 18, 2006 5:27 pm

I'm using tugzip which supports 7z, however I see that the LZMA algorithm that is used in 7z only supports multi-threading but not multi-processing.

Any other suggestions?

My T60p dead right now, but I will be replacing it with a dual core system.

yossarian · #10 Post by **yossarian** » Tue Apr 18, 2006 9:25 pm

Multithreaded applications will benefit from multiple processors.

DIGITALgimpus · #11 Post by **DIGITALgimpus** » Tue Apr 18, 2006 11:56 pm

davidspalding wrote:Our Visual Studio server uses that. I like the 7zip utility ... lean, quick, simple. The way I like my shareware, and my women (he said, ducking from the inevitable slap from a feminist, which I am also actually).

You get a slap for calling it shareware, when it's actually open source and completely free!

/from an open source advocate and hacker.

davidspalding · #12 Post by **davidspalding** » Wed Apr 19, 2006 9:29 am

Quite right, sir. But being an old fart, I often throw money even at the "donate-ware" apps that I use daily. Hence my mistake.

/ The Spalding Foundation, now in its 15th year of software donations.

Multiple CPU supported compression (zip, rar...) utility?

Multiple CPU supported compression (zip, rar...) utility?

Who is online