1

Loading and saving files in a compressed format


J
Jane

Files can get big, very big. and they compress quite well. a 4gig file goes down to 200meg when zipped. Of course saving and loading those files is slower when working on an SSD, but might be faster when working with a spinning disk or over the network. and save lots of space when storing files for longer periods of time

A

Activity Newest / Oldest

J

Jane

Hardkrash Jul 11, 2018
I did a quick benchmark using tar using xz compression at level 1 compression a 1.99GB logic data file down to to 75MB in 40 seconds on my 2.6 GHz Intel Core i7, 16GB MacBook Pro.

Hardkrash Jul 11, 2018
Typically loading and saving compressed files is faster, as io bandwidth is a limiting factor. Even with fast SSD drives minimal compression should help. Network drives and other interfaces would benefit as well.
See:
- zlib en.wikipedia.org/wiki/Zlib
- xz en.wikipedia.org/wiki/Xz

Will Jul 11, 2018
It would be great if .logicdata files were simply compressed always (or some new extension that becomes the new default), just like how .xlsx files are zip'ed XML files. As noted they do tend to compress quite well so they would take much less space and be easier/faster to transfer.

Tom Hughes Apr 1, 2019
+1

Guest Apr 29, 2019
storing 50GB is long in all cases (took me like 5 minutes), but when I compress the resulting file using fast mode with 7-zip it takes like 40 seconds to end with a 1.6BG file!! So it would make sense that doing both operations as a single step (file "compressed-logicdata") from RAM (or pagefile..) to disk, would be both more efficient and convenient.

Joe Garrison May 1, 2019
Def. will do this! Will optimize for speed and should make a large difference. Look for this in the Alpha discuss.saleae.com/ by ~ July.

Later on the plan is to offer optional analog downsampling and/or lossy compression.

Joe Garrison May 1, 2019
We'll also try and make it so that saving to disk is a background task that still lets you use the app.