Update Changelog for new release.
This commit is contained in:
parent
62568e9066
commit
16a8d2fcf4
1 changed files with 126 additions and 0 deletions
126
Changelog
126
Changelog
|
@ -1,3 +1,120 @@
|
||||||
|
== 3.0 Major Beta Release ==
|
||||||
|
Basic capability to list contents of an archive without extracting to disk.
|
||||||
|
Bump version and update command help text.
|
||||||
|
Update README with additional option details.
|
||||||
|
Change nftw() to depth-first scan to handle restoring directory permissions correctly.
|
||||||
|
When sorting cause directories to be sorted after files and in descending order of nesting level.
|
||||||
|
Take out stray printf().
|
||||||
|
Detect some DICOM formats and use BSC for DICOM data.
|
||||||
|
Overhaul documentation part #1
|
||||||
|
Detect and handle uncompressed PDF files using libbsc.
|
||||||
|
Force binary/text data detection for tar archives.
|
||||||
|
Get rid of unnecessary CLI option.
|
||||||
|
Add full pipeline mode check when archiving.
|
||||||
|
Update to PackJPG 2.5i.
|
||||||
|
Fixes crash with malformed Jpeg.
|
||||||
|
Fix issue #12.
|
||||||
|
Fix issue #13.
|
||||||
|
Create output directory with correct mode.
|
||||||
|
Fix the flow where pathname list is not sorted.
|
||||||
|
Fix ppmd decompression bug introduced in previous commit.
|
||||||
|
Reduce compression level for automatic pathname sorting.
|
||||||
|
Change to extraction directory only after opening archive.
|
||||||
|
Free PPMD buffer after compression, rather than caching.
|
||||||
|
Introduce new API in allocator to release buffer to OS.
|
||||||
|
Release LZMA buffers after use.
|
||||||
|
Drastically reduce memory consumption of PPMD8 in adaptive mode (Use lower max model order).
|
||||||
|
Detect AR archives and set the type.
|
||||||
|
Re-use a less common type code for AR.
|
||||||
|
Use Dispack generically for all executables and AR archives.
|
||||||
|
Move MSDOS COM single-byte magic number checks to last in the list.
|
||||||
|
Move advanced options flag into context structure.
|
||||||
|
Include dtd files as text type.
|
||||||
|
Update PackJPG to version 2.5h.
|
||||||
|
Fix missing bounds checking in Delta2.
|
||||||
|
Check harder with more strides in Delta2 for extreme compression levels.
|
||||||
|
Make LibArchive filter process buffer more generic.
|
||||||
|
Include explicit CLI flags for PackJPG and Dispack.
|
||||||
|
Avoid auto-selection of filters if advanced options are specified.
|
||||||
|
Add more robust checks for Jpeg and packJPG format files in filter routine.
|
||||||
|
Use case-insensitive checks for extension names.
|
||||||
|
Enable more features based on compression level, when archiving.
|
||||||
|
Do not use Libbsc for TIFFs. Not all TIFFs compress well with Libbsc.
|
||||||
|
Fix DEBUG-STATS build for Dispack.
|
||||||
|
Use adapt2 as default compression in archive mode.
|
||||||
|
Add more filter auto-selection by compression level in archive mode.
|
||||||
|
Replace odd stride lengths in Delta2 with standard numeric type lengths and improve performance.
|
||||||
|
Remove fast path exit to allow compressing headers and zero paddings via LZ4.
|
||||||
|
Use libbsc for AVI and MP4 files.
|
||||||
|
Use Libbsc for MP4 and FLAC files.
|
||||||
|
Change some rare file type codes to indicate some common types.
|
||||||
|
Use Libbsc for TIFF images.
|
||||||
|
Workaround for packJPG limitation.
|
||||||
|
Remove external Libbsc option.
|
||||||
|
Add forked and optimized copy of LGPL version of Libbsc.
|
||||||
|
Strip out Sort Transform from Libbsc copy.
|
||||||
|
Reduce Libbsc memory use.
|
||||||
|
Avoid redundant adler32 of data block in Libbsc.
|
||||||
|
Use Libbsc for DNA Sequence data instead of PPMD. Faster, better compression.
|
||||||
|
Fix pz extension handling for real.
|
||||||
|
Avoid Delta2,LZP for TIFF files. Negatively impacts compression.
|
||||||
|
Use libbsc/ppmd for BMP files.
|
||||||
|
Fix extension based hashing.
|
||||||
|
Do not append .pz extension to filenames already having it.
|
||||||
|
Some code formatting changes.
|
||||||
|
Fix PackJPG library usage. PackJPG interface doc is incomplete, ugh!
|
||||||
|
Handle the case where PackJPG expands the file rather than compressing.
|
||||||
|
Fix Dispack decoding.
|
||||||
|
Add Dispack filter with auto-detection of x86 executables in archive mode.
|
||||||
|
More elaborate magic header based detection of 32-bit and 64-bit x86 binaries.
|
||||||
|
Always use fast-mode LZ4 in Adaptive modes.
|
||||||
|
Optimize preprocessed compression and avoid a bunch of memory copies.
|
||||||
|
Fix a crash.
|
||||||
|
Add a few more file types.
|
||||||
|
More comments.
|
||||||
|
Fix fd leak.
|
||||||
|
Fix issues when handling Jpegs where packJPG borks.
|
||||||
|
Add fast handling of totally incompressible data (like Jpegs) in adaptive modes.
|
||||||
|
Add function to indicate totally incompressible data when archiving.
|
||||||
|
Reformat if statements in some places to reduce branching.
|
||||||
|
Enable auto-filtering of archive entries based on compression level.
|
||||||
|
Miscellaneous fixes.
|
||||||
|
Work in progress changes for packJPG encoding and decoding.
|
||||||
|
Enhance custom LibArchive filter functionlity.
|
||||||
|
Add basic framework for file type based filters during libarchive stage.
|
||||||
|
Add packJPG filter for Jpeg files (not active yet).
|
||||||
|
Directory format changes for clarity.
|
||||||
|
Add own implementation of archive entry extraction to allow custom filters.
|
||||||
|
Fix magic number check for endianness.
|
||||||
|
Structured handling of file types.
|
||||||
|
Handling of already compressed data based on compression algorithm.
|
||||||
|
Add a few more extension types.
|
||||||
|
Leverage file type detection(archiver) to improve compression performance.
|
||||||
|
Use detected file/data type(archiver) for Adaptive compression modes.
|
||||||
|
Update type flags and add more extensions.
|
||||||
|
Add file type detection based on magic values.
|
||||||
|
Add extension based file type detection and setting segment data type.
|
||||||
|
Use Bob Jenkins Minimal Perfect Hash to check for known extensions.
|
||||||
|
Use semaphore signaling and direct buffer copy for extraction.
|
||||||
|
Clear off private xattrs when extracting.
|
||||||
|
Enable pathname sorting only for high compression levels.
|
||||||
|
Replace slow pipe with direct memory copy for archive extraction.
|
||||||
|
Avoid using pipe during archive creation. Use semaphores and direct memory copy.
|
||||||
|
Use mmap to read from the pathlist file for performance.
|
||||||
|
Functionality to sort pathnames based on file extension and size.
|
||||||
|
More changes for archiving.
|
||||||
|
Allow multiple filenames on command line when archiving.
|
||||||
|
Remove unneded small block writes with libarchive.
|
||||||
|
Make log_msg() add newline by default.
|
||||||
|
Archiving support using Libarchive.
|
||||||
|
Change all perror() calls to use logger.
|
||||||
|
Make the config script a little verbose.
|
||||||
|
Ability to specify output compressed pathname.
|
||||||
|
Fix log level handling.
|
||||||
|
Add a simple log facility.
|
||||||
|
Refactor all printfs to use log facility.
|
||||||
|
Cleanup pointer casting in code to use macros.
|
||||||
|
|
||||||
== 2.4 Bugfix Release ==
|
== 2.4 Bugfix Release ==
|
||||||
Add identifiers to error messages for clarity.
|
Add identifiers to error messages for clarity.
|
||||||
Fix init of dedupe block size.
|
Fix init of dedupe block size.
|
||||||
|
@ -23,6 +140,7 @@ Reduce memory threshold for switching to Similarity based Deduplication.
|
||||||
Avoid unnecessary re-hashing of 64-bit keys of the segment index.
|
Avoid unnecessary re-hashing of 64-bit keys of the segment index.
|
||||||
Update free memory computation to include cached buffers.
|
Update free memory computation to include cached buffers.
|
||||||
Fix a potential rare corner case.
|
Fix a potential rare corner case.
|
||||||
|
|
||||||
== 2.3 Update Release ==
|
== 2.3 Update Release ==
|
||||||
Fix multiple crashes for some corner cases.
|
Fix multiple crashes for some corner cases.
|
||||||
Increase max block size for variable dedup block sizes greater than 16KB.
|
Increase max block size for variable dedup block sizes greater than 16KB.
|
||||||
|
@ -42,6 +160,7 @@ Remove an rpath entry meant for testing.
|
||||||
Make default symbol visibility to hidden with explicit public visibility specified.
|
Make default symbol visibility to hidden with explicit public visibility specified.
|
||||||
Add missing static scope to a few more places.
|
Add missing static scope to a few more places.
|
||||||
Make Pcompress functionality into a library - initial changes.
|
Make Pcompress functionality into a library - initial changes.
|
||||||
|
|
||||||
== 2.2 Bugfix Release ==
|
== 2.2 Bugfix Release ==
|
||||||
Update invalid environment variable handling to actually fail rather than auto-correct.
|
Update invalid environment variable handling to actually fail rather than auto-correct.
|
||||||
Fix a crash with invalid PCOMPRESS_CHUNK_HASH_GLOBAL.
|
Fix a crash with invalid PCOMPRESS_CHUNK_HASH_GLOBAL.
|
||||||
|
@ -51,6 +170,7 @@ Correspond segment size to chunk size for Segmented Dedupe for better accuracy.
|
||||||
Add a testcase for issue #10.
|
Add a testcase for issue #10.
|
||||||
Fix issue #10.
|
Fix issue #10.
|
||||||
Fix issue #8.
|
Fix issue #8.
|
||||||
|
|
||||||
== 2.1 Update Release ==
|
== 2.1 Update Release ==
|
||||||
Add more tests covering Segmented Global Dedupe.
|
Add more tests covering Segmented Global Dedupe.
|
||||||
Fix some tests.
|
Fix some tests.
|
||||||
|
@ -80,6 +200,7 @@ Use closer min-values sampling for improved segmented dedupe accuracy.
|
||||||
Update proper checksum info in README.
|
Update proper checksum info in README.
|
||||||
Fix sizing of similarity hash buffer.
|
Fix sizing of similarity hash buffer.
|
||||||
Tweak index size computation.
|
Tweak index size computation.
|
||||||
|
|
||||||
== 2.0 Major Release ==
|
== 2.0 Major Release ==
|
||||||
Add test cases for Global Deduplication.
|
Add test cases for Global Deduplication.
|
||||||
Update documentation and code comments.
|
Update documentation and code comments.
|
||||||
|
@ -129,6 +250,7 @@ Fix location of sem_wait().
|
||||||
More comments.
|
More comments.
|
||||||
Add check to disable Delta Compression with Global deduplication for now.
|
Add check to disable Delta Compression with Global deduplication for now.
|
||||||
Implement Global Deduplication.
|
Implement Global Deduplication.
|
||||||
|
|
||||||
== 1.4.0 Update Release ==
|
== 1.4.0 Update Release ==
|
||||||
Update couple more test parameters with new crypto options.
|
Update couple more test parameters with new crypto options.
|
||||||
Update README and test cases with new crypto options.
|
Update README and test cases with new crypto options.
|
||||||
|
@ -168,6 +290,7 @@ Update xxhash comment.
|
||||||
Reduce dedupe hash table collisions by half.
|
Reduce dedupe hash table collisions by half.
|
||||||
Improve Deduplication performance by another 95%.
|
Improve Deduplication performance by another 95%.
|
||||||
Start sliding window scanning near minimum chunk size boundaries to avoid scanning whole chunk.
|
Start sliding window scanning near minimum chunk size boundaries to avoid scanning whole chunk.
|
||||||
|
|
||||||
== 1.3.0 Major Performance Release ==
|
== 1.3.0 Major Performance Release ==
|
||||||
Fix return from parallel versions of Keccak_Hash() function.
|
Fix return from parallel versions of Keccak_Hash() function.
|
||||||
Add parallel versions of various checksums for single-segment, single-thread compression.
|
Add parallel versions of various checksums for single-segment, single-thread compression.
|
||||||
|
@ -318,6 +441,7 @@ Portability to Debian based distros.
|
||||||
Enable SSE4/AVX detection for AMD platforms (Bulldozer has both).
|
Enable SSE4/AVX detection for AMD platforms (Bulldozer has both).
|
||||||
Portable long long int print formatting to silence gcc 4.6 warnings.
|
Portable long long int print formatting to silence gcc 4.6 warnings.
|
||||||
Add another example invocation.
|
Add another example invocation.
|
||||||
|
|
||||||
== 0.9.0 Major Release ==
|
== 0.9.0 Major Release ==
|
||||||
Implement HMAC verification for chunk header.
|
Implement HMAC verification for chunk header.
|
||||||
Do not ask for decryption passwd twice.
|
Do not ask for decryption passwd twice.
|
||||||
|
@ -330,6 +454,7 @@ Couple of minor fixes.
|
||||||
Incorporate SSE/AVX optimized Intel SHA-256 implementation.
|
Incorporate SSE/AVX optimized Intel SHA-256 implementation.
|
||||||
Add support for runtime cpuid detection.
|
Add support for runtime cpuid detection.
|
||||||
Add support for SHA256 and SHA512 digests from OpenSSL library.
|
Add support for SHA256 and SHA512 digests from OpenSSL library.
|
||||||
|
|
||||||
== 0.8.6 Update Release ==
|
== 0.8.6 Update Release ==
|
||||||
Fix polynomial computation.
|
Fix polynomial computation.
|
||||||
Fix incorrect block length when doing fixed-block dedupe.
|
Fix incorrect block length when doing fixed-block dedupe.
|
||||||
|
@ -422,6 +547,7 @@ Fix buffer sizing for LZ4.
|
||||||
Fix exit condition checks in LZ4 decompression wrapper.
|
Fix exit condition checks in LZ4 decompression wrapper.
|
||||||
Fix buffer size calculation when decompressing LZ4, Zlib and Bzip2 compressed chunks.
|
Fix buffer size calculation when decompressing LZ4, Zlib and Bzip2 compressed chunks.
|
||||||
Slight SSE optimization in LZ4HC.
|
Slight SSE optimization in LZ4HC.
|
||||||
|
|
||||||
== 0.6 Alpha bugfix release ==
|
== 0.6 Alpha bugfix release ==
|
||||||
Fix crash when algo init function returns error.
|
Fix crash when algo init function returns error.
|
||||||
Fix LZFX error handling.
|
Fix LZFX error handling.
|
||||||
|
|
Loading…
Reference in a new issue