Commit Graph

38 Commits (61d6353e07ad141edf58149713a53afbd308edb7)

Author SHA1 Message Date
Dave Vasilevsky 870ce29ce5 Fix issue 10: Uncompressible data causes overrun
lzma_code() doesn't automatically handle the case where data doesn't compress
well. Unfortunately the only way to do this with liblzma API is to use single-
call block encoder, but that wouldn't let us re-use the lzma_stream.

So we roll our own uncompressed-block output, based on the LZMA spec. It's
ugly, but it works.
12 years ago
Dave Vasilevsky 5f36662909 Reduce memory usage further by buffer-allocation laziness 12 years ago
Dave Vasilevsky 878e8e0585 Change default block fraction to 2.0 12 years ago
Dave Vasilevsky 13f6237b67 Don't pre-allocate blocks while compressing 12 years ago
Dave Vasilevsky 948d0b4e5d Add block-fraction option 12 years ago
Dave Vasilevsky 7820ec52b9 cleanup 12 years ago
Dave Vasilevsky ea64c94c21 We handle EOF fine now 12 years ago
Dave Vasilevsky 1505bc8c86 Write the compressed/uncompressed size into block headers 12 years ago
Dave Vasilevsky 7518c32900 Don't truncate files at end of tar content 12 years ago
Dave Vasilevsky f28ba365fa Fix race condition; header cleanup 14 years ago
Dave Vasilevsky 4713b32cf1 Single driver 14 years ago
Dave Vasilevsky e675206a8e Move operations to functions 14 years ago
Dave Vasilevsky cfa025697d Fix writing last file; Make pixz_read into a function 14 years ago
Dave Vasilevsky 9d0c5e314a Allow copyfile multiple-headers; fix eof bug. 14 years ago
Dave Vasilevsky 0357c6413c Parallel extraction! 14 years ago
Dave Vasilevsky 6da292fe53 Generalize pipeline 14 years ago
Dave Vasilevsky a1cd0e174e List can be a filter too; update usage 14 years ago
Dave Vasilevsky 86e0a1998c Let write be a filter 14 years ago
Dave Vasilevsky 14d6d92e87 Allow setting compression level 14 years ago
Dave Vasilevsky 9cd29befca Allow writing non-tar archives 14 years ago
Dave Vasilevsky 4ab346deff Use magic number to identify index 14 years ago
Dave Vasilevsky 16f0d6e2ed streaming writes 14 years ago
Dave Vasilevsky 73e14a5272 Update for liblzma index API changes 14 years ago
Dave Vasilevsky 8d0e61afca suppress unused var warning 15 years ago
root 5f22300a92 add thread debugging info 15 years ago
root c158b057f2 simpler block queuing; go back to dict_size blocks; run test in bash, some sh have no "time" 15 years ago
root 8a90a6dce7 free queue contents properly; use input queue for memory limiting 15 years ago
Dave Vasilevsky 9b0c2bd95b Dynamically determine the number of CPUs--now we're actually useful 15 years ago
Dave Vasilevsky 67541dc95d Linux support, woo 15 years ago
Dave Vasilevsky 44b3dcac3b Use slightly more efficient (?) block size 15 years ago
Dave Vasilevsky 4ca208ccd8 Find blocksize dynamically based on dict_size 15 years ago
Dave Vasilevsky 804124e82b multi-threaded encoding 15 years ago
Dave Vasilevsky 42302434a7 Use threads and queues--still single-threaded 15 years ago
Dave Vasilevsky bc649b9877 factor out common code 15 years ago
Dave Vasilevsky 9fb824505b Pull a single file out of archive 15 years ago
Dave Vasilevsky f80c73499a Read index names; allow weird CHUNKSIZE 15 years ago
Dave Vasilevsky ba095bb055 create a compressed tar file with a file index 15 years ago
Dave Vasilevsky 62443a29fe new, simple-but-ugly test writer 15 years ago