greg/pcompress
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
401 commits 3 branches 21 tags 7.6 MiB
Commit graph

401 commits

This branch
This branch
All branches
Author SHA1 Message Date
Moinak Ghosh
b2ad225fbb iImplement fast TOC listing for metadata streams. 
Fix help text.
Removed redundant allocator code.
Actually free memory on exit.
 2014-11-03 20:20:05 +05:30
Moinak Ghosh
3259c7ced0 Fix sub-type count. 2014-10-27 21:23:03 +05:30
Moinak Ghosh
b7804a0caa Improve file sorting algorithm. 
Add more file extension names.
Fix data type mask size.
 2014-10-27 19:23:03 +05:30
Moinak Ghosh
cc68550670 Add metadata stream flag for archive. 
Change flag bit to not collide with checksum id.
Handle '-T' option properly.
 2014-10-25 22:57:31 +05:30
Moinak Ghosh
e7081eb5a3 Git commit - rehash. Incorrect earlier commit. 
Implement Separate metadata stream.
Fix blatant wrong check in Bzip2 compressor.
Implement E8E9 filter fallback in Dispack.
Improve dict buffer size checks.
Reduce thread count to control memory usage in archive mode.
 2014-10-24 23:30:40 +05:30
Moinak Ghosh
1a00613457 Changes for future feature (disabled now): Separate metadata stream. 
Fix blatant wrong check in Bzip2 compressor.
Implement E8E9 filter fallback in Dispack.
Improve dict buffer size checks.
Reduce thread count to control memory usage in archive mode.
 2014-10-24 21:12:48 +05:30
Moinak Ghosh
e3c32ed6d6 Remove unneeded archive writing function. 
Improve filter scratch buffer handling.
Improve memory accounting.
Remove delayed allocation when compressing. Allows better memory estimation.
Some cstyle fixes.
 2014-09-24 21:54:36 +05:30
Moinak Ghosh
6ba9c4b721 Change EXE code detection process to CSC's Analyzer. 2014-09-23 21:19:10 +05:30
Moinak Ghosh
4c3f3d5ee2 Libarchive tweaks to indicate data vs metadata reads and writes. 2014-09-22 21:21:52 +05:30
Moinak Ghosh
3debf1340c Fix missing newline in error message. 2014-09-21 22:08:10 +05:30
Moinak Ghosh
50643b1f93 Fix libarchive configure and makefiles for Linux build. 2014-09-21 19:57:28 +05:30
Moinak Ghosh
3fedef7f7f Add missing file for clean libarchive build. 2014-09-20 22:06:36 +05:30
Moinak Ghosh
2e5f2d8aab Make DICT filter useful. 
Improve data analysis in adaptive_compress.
 2014-09-20 21:49:06 +05:30
Moinak Ghosh
071a9e2b26 Update,simplify analyzer function to indicate text data for Dict filter. 
Fix archive header writing bug.
Strip ^M chars from dict filter files.
Include DICT preprocessing type.
Fix a bunch of bugs found by Xcode.
 2014-09-20 12:49:00 +05:30
Moinak Ghosh
4fedebc607 Dict filter work in progress. 2014-09-18 22:51:25 +05:30
Moinak Ghosh
f34962f8cc Set Wavpack compression mode based on compression level. 2014-09-17 21:43:00 +05:30
Moinak Ghosh
af39994a59 Working Wavpack filter for compressing WAV filies. 
Improved error handling of filter routines.
Improved verbose logging.
 2014-09-17 20:34:38 +05:30
Moinak Ghosh
fd087a8949 Step 0 of adding WavPack filter - does not work yet. 
WAV file detection.
Rename libarchive dir to be generic.
 2014-09-14 23:56:38 +05:30
Moinak Ghosh
5a875f3174 Regenerate extensions hash. 2014-09-12 17:00:36 +05:30
Moinak Ghosh
3e9a46a602 Add tagging of filter-processed entries with custom XATTR. 
Add magic number based detection of JPEG and PNM formats.
 2014-09-11 20:29:53 +05:30
Moinak Ghosh
08a30d270d Add caller-defined xattr handling features to private libarchive. 2014-09-11 19:17:02 +05:30
Moinak Ghosh
9ecbbbafd0 Pull in private copy of libarchive to add pcmpress-specific functionality. 
First step to add packPNM support.
 2014-09-11 18:34:43 +05:30
Moinak Ghosh
9feee0a36d Add MPLv2 license forking script. 2014-08-28 23:06:02 +05:30
Moinak Ghosh
376a56622b Several fixes for issue #21. 2014-08-28 22:48:36 +05:30
Moinak Ghosh
d5ceda559e Update Licensing notes and build notes. 
More whitespace fixes.
 2014-07-26 15:28:40 +05:30
Moinak Ghosh
c1411a6af6 More whitespace cleanup and MPLv2 licensing support. 2014-07-24 23:48:42 +05:30
Moinak Ghosh
10f40e1c6f Part 1 changes to allow dual licensing to MPLV2. 
Make external LGPL code/features disabled in MPLV2 variant.
Nuke some unwanted whitespace (cstyle).
 2014-07-24 22:20:30 +05:30
Moinak Ghosh
0433452b37 Miscellaneous refactoring. 
Add some headers for OSX.
 2014-05-24 23:52:30 +05:30
Moinak Ghosh
a6676698fa Configurable optimization level for libbsc. 2014-05-09 22:58:51 +05:30
Moinak Ghosh
63509327e4 Tweak optimization flags for libbsc. 
Reduce max opt level on OS X to avoid crashes due to Gcc code generation quirks.
 2014-05-09 22:53:47 +05:30
Moinak Ghosh
a62e1aa5f7 Config script option to disable AVX. 
Fix compiler (Gcc 4.9) warnings.
 2014-05-05 19:40:53 +05:30
Moinak Ghosh
125828b6b3 Update CPUID detection for AVX2. 2014-05-04 22:35:12 +05:30
Moinak Ghosh
7055a8fc71 Add AVX detection and usage of -mavx[2] flags. 
Force GCC to use Clang assembler always on MAC OS X for AVX support.
 2014-05-04 22:03:40 +05:30
Moinak Ghosh
63bef473cc Working MAC OS X port. 
Compatibility layer for semaphore handling.
 2014-05-04 21:11:31 +05:30
Moinak Ghosh
7830473c65 Avoid cleaning buildtmp for make clean. Causes subsequent make to fail. 2014-05-04 19:55:01 +05:30
Moinak Ghosh
9cbdd7ce8c Fix Libbsc and dynamic lib builds. 2014-05-04 14:45:07 +05:30
Moinak Ghosh
4a9cd8c48e More portability tweaks. 
Fix compiler warnings.
 2014-05-04 13:32:11 +05:30
Moinak Ghosh
4b037f0ed7 More portability tweaks. 2014-05-04 11:54:33 +05:30
Moinak Ghosh
f2da433188 More portability tweaks. 
Handle platform specific yasm parameters.
Resolve namespace conflict on OSX.
Do not build Skein ASM code on OSX.
 2014-04-30 22:46:24 +05:30
Moinak Ghosh
6fba8aa8ac More OSX compatibility code. 
Fix new warnings with Gcc 4.8.
 2014-04-28 00:12:51 +05:30
Moinak Ghosh
8b52f7ccb8 Some initial tidbits for the start of an OSX/Windows port. 2014-04-26 23:05:14 +05:30
Moinak Ghosh
935717373b Capability to list offset and length of each block when deduplication for external use. 2014-03-30 17:35:21 +05:30
Moinak Ghosh
2f11e11717 Bump Version and update Changelog for 3.1 Release. 2014-03-02 18:46:03 +05:30
Moinak Ghosh
c15957b990 Avoid auto-selection variable chunking for buffer sizes below threshold. 2014-03-02 17:13:31 +05:30
Moinak Ghosh
9d40f3c2fb Do not auto-select Global Dedupe for below threshold buffers. 2014-02-22 23:34:26 +05:30
Moinak Ghosh
8a1f47917f Fix issue #18. 
Do not try to generate a target filename in pipe mode.
 2014-02-05 23:43:07 +05:30
Moinak Ghosh
2702544d3f Scale default compression buffer size for levels > 8. 2014-01-29 23:27:53 +05:30
Moinak Ghosh
33281a2257 Fix issue #17. 
Use LZ4 and Libbsc extra padding space for the compression buffer in adaptive modes.
 2014-01-29 00:12:04 +05:30
Moinak Ghosh
518ecf23a7 Fix issue #16. 2014-01-28 20:44:45 +05:30
Moinak Ghosh
f8d3ddfe39 Fix issue #15. 2014-01-15 22:42:18 +05:30