greg/pcompress
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
138 commits 3 branches 21 tags 7.6 MiB
Commit graph

24 commits

Author SHA1 Message Date
Moinak Ghosh
24d5368f7f Update README. 2012-12-05 00:12:29 +05:30
Moinak Ghosh
2909a3abff Update README. 2012-11-18 23:19:22 +05:30
Moinak Ghosh
45487469d1 Add another example invocation. 2012-10-21 12:34:34 +05:30
Moinak Ghosh
f2d7bea902 Support for chunk-level encryption using AES and Scrypt based PBE. 
Couple of minor fixes.
 2012-10-15 12:10:00 +05:30
Moinak Ghosh
2578676b1b Add support for SHA256 and SHA512 digests from OpenSSL library. 2012-10-03 22:43:02 +05:30
Moinak Ghosh
0019efbadb Adjust break pattern check mask for closer approximation to average block size. 
Remove unused structure member.
 2012-09-29 23:31:45 +05:30
Moinak Ghosh
8f8af7ed6b Update adaptive mode heuristic based on algorithms. 
Remove incorrect check in PPMd decompression code.
More refactoring of variable names.
 2012-09-27 22:29:08 +05:30
Moinak Ghosh
449dc35675 Speed up adaptive modes by using heuristics to select compression algorithm. 
Select similarity percentage based on dedupe block size for effectiveness.
 2012-09-26 19:47:32 +05:30
Moinak Ghosh
3544a8c708 Fix polynomial table computation. 
Change hashing and length bias to reduce hashtable bucket collisions.
Add support for user-selectable 60% or 40% similarity for Delta Compression.
Overall slight speedup.
 2012-09-24 22:20:27 +05:30
Moinak Ghosh
e3befd9e16 Add support for Fixed-Block deduplication. 
More refactoring of symbol names.
 2012-09-16 11:12:58 +05:30
Moinak Ghosh
b9355a5dcc Reduce dedupe loop checks for slight speed edge. 
Beginnings of Fixed-block dedupe.
Update variable name for clarity.
 2012-09-15 11:14:58 +05:30
Moinak Ghosh
117382c141 Update README to reflect current features. 2012-09-07 21:32:20 +05:30
Moinak Ghosh
4ba840b255 Add ASM version of Skein for x64 platforms with auto-detection 
Error checking for checksum flag when decompressing
Update comments and READMEs
 2012-09-01 14:40:15 +05:30
Moinak Ghosh
a222772940 Fix single chunk flag handling during decompression. 
Update docs.
 2012-08-27 22:24:23 +05:30
Moinak Ghosh
d75535bc7e Add support for libbsc a high-performance block sorting compressor. 
Enable external algorithm threading for single chunk compressed files.
Update docs.
 2012-08-27 21:51:55 +05:30
Moinak Ghosh
3b83bc2d4e Bump file version. 2012-08-26 15:01:18 +05:30
Moinak Ghosh
bf149e880d Add LZP Pre-Compression support ported from libbsc. 
Add generic pre-processing wrappers for future support of other pre-processors.
Clean up computation of Rabin block sizes.
Compute Rabin scratch space accurately to avoid RAM wastage.
 2012-08-23 22:58:44 +05:30
Moinak Ghosh
3851c9c6cc Delay allocation of per-thread chunks for performance and memory efficiency. 
Avoid allocating double-buffer for single-chunk files.
Introduce lzmaMt option to indicate multithreaded LZMA.
Update README.
 2012-08-18 22:00:14 +05:30
Moinak Ghosh
3150bdbed7 Implement secondary sketch based on character counts to refine similarity checksum. 
Proper checksum update for last block.
Update comments.
 2012-08-12 13:06:49 +05:30
Moinak Ghosh
2c516c009c Fix crash when algo init function returns error. 
Fix LZFX error handling.
More updates to README.
 2012-07-31 21:07:35 +05:30
Moinak Ghosh
94563a7ecd Fix buffer size computation when allocating Rabin block array. 
Reduce memory usage of Rabin block array.
Add an SSE optimization for bsdiff.
Move integer hashing function to utils file.
More updates to README.
 2012-07-28 23:55:24 +05:30
Moinak Ghosh
f83652aa90 Update README. 2012-07-27 22:25:44 +05:30
Moinak Ghosh
c7cc7b469c Update chunk size computation to reduce memory usage. 
Implement runtime bypass of custom allocator.
Update README.
 2012-07-27 22:03:24 +05:30
moinakg
10e0a75b67 Initial commit 2012-05-19 08:54:47 -07:00