Moinak Ghosh
077da83d5d
A bunch of small fixes in Dict.
...
Improve text analysis for markup tags.
Use Libbsc for plain text and PPMd for markup mixed text.
Change thresholds.
2015-01-11 17:36:46 +05:30
Moinak Ghosh
66a482c968
A new Dictionary preprocessor for text files.
2015-01-09 22:13:24 +05:30
Moinak Ghosh
73307c3996
Multiple checks and balances in Dispack to avoid buffer overlfow.
...
Allow filter variants to omit the standard header.
Use E8E9 in Dispack filter as a fallback.
Fix integer overflow for type value in thread data struct.
Do not inline functions in DEBUG build.
2014-12-21 14:13:58 +05:30
Moinak Ghosh
1db822d866
Add Dispack file-level filter in the libarchive chain.
...
Add new file type for Win32-PE executables (Dispack).
Reset file type flag after filter processing for better compression.
Fix array index handling for file type list.
2014-12-20 11:24:09 +05:30
Moinak Ghosh
9a5361f010
Misclleanous cleanups.
...
Fix some formatting.
Increase metadata chunk size slightly.
2014-12-19 19:15:39 +05:30
Moinak Ghosh
f970b41e34
A bunch of improvements and fixes.
...
- Fix heap corruption in DICT Filter.
- Make default Dedup block size as 8KB.
- Revamp executable file handling: Part#1.
- Developed new E8E9 filter that works better than Dispack on raw data blocks.
- Remove block-based Dispack encoding. File-specific Dispack filter to be added.
- Improve file header based executable file detection.
- Introduce new sorting algorithm for filenames without extension.
2014-12-11 19:15:36 +05:30
Moinak Ghosh
507e7c75d3
Centralise data analysis routine for optimum performance and leverage.
...
Utilise buffer data analysis for preprocessing filters.
2014-11-06 22:23:33 +05:30
Moinak Ghosh
e7081eb5a3
Git commit - rehash. Incorrect earlier commit.
...
Implement Separate metadata stream.
Fix blatant wrong check in Bzip2 compressor.
Implement E8E9 filter fallback in Dispack.
Improve dict buffer size checks.
Reduce thread count to control memory usage in archive mode.
2014-10-24 23:30:40 +05:30
Moinak Ghosh
6ba9c4b721
Change EXE code detection process to CSC's Analyzer.
2014-09-23 21:19:10 +05:30
Moinak Ghosh
2e5f2d8aab
Make DICT filter useful.
...
Improve data analysis in adaptive_compress.
2014-09-20 21:49:06 +05:30
Moinak Ghosh
071a9e2b26
Update,simplify analyzer function to indicate text data for Dict filter.
...
Fix archive header writing bug.
Strip ^M chars from dict filter files.
Include DICT preprocessing type.
Fix a bunch of bugs found by Xcode.
2014-09-20 12:49:00 +05:30
Moinak Ghosh
4fedebc607
Dict filter work in progress.
2014-09-18 22:51:25 +05:30
Moinak Ghosh
9ecbbbafd0
Pull in private copy of libarchive to add pcmpress-specific functionality.
...
First step to add packPNM support.
2014-09-11 18:34:43 +05:30
Moinak Ghosh
376a56622b
Several fixes for issue #21 .
2014-08-28 22:48:36 +05:30
Moinak Ghosh
d5ceda559e
Update Licensing notes and build notes.
...
More whitespace fixes.
2014-07-26 15:28:40 +05:30
Moinak Ghosh
10f40e1c6f
Part 1 changes to allow dual licensing to MPLV2.
...
Make external LGPL code/features disabled in MPLV2 variant.
Nuke some unwanted whitespace (cstyle).
2014-07-24 22:20:30 +05:30
Moinak Ghosh
4a9cd8c48e
More portability tweaks.
...
Fix compiler warnings.
2014-05-04 13:32:11 +05:30
Moinak Ghosh
35043a74b0
Update to PackJPG 2.5i.
...
Fixes crash with malformed Jpeg.
2013-12-28 21:56:03 +05:30
Moinak Ghosh
dcc64d9e47
Update PackJPG to version 2.5h.
...
Fix missing bounds checking in Delta2.
2013-12-14 20:58:59 +05:30
Moinak Ghosh
a851bac247
Check harder with more strides in Delta2 for extreme compression levels.
2013-12-13 19:53:14 +05:30
Moinak Ghosh
36ed5d5a78
Use adapt2 as default compression in archive mode.
...
Add more filter auto-selection by compression level in archive mode.
Replace odd stride lengths in Delta2 with standard numeric type lengths and improve performance.
2013-12-05 22:20:01 +05:30
Moinak Ghosh
4923551570
Fix Dispack decoding.
2013-11-24 22:44:35 +05:30
Moinak Ghosh
0192790c02
Add Dispack filter with auto-detection of x86 executables in archive mode.
...
More elaborate magic header based detection of 32-bit and 64-bit x86 binaries.
Always use fast-mode LZ4 in Adaptive modes.
2013-11-24 19:45:58 +05:30
Moinak Ghosh
e90c52e516
Work in progress changes for packJPG encoding and decoding.
...
Enhance custom LibArchive filter functionlity.
2013-11-13 23:28:01 +05:30
Moinak Ghosh
75dfa6a6fb
Add basic framework for file type based filters during libarchive stage.
...
Add packJPG filter for Jpeg files (not active yet).
Directory format changes for clarity.
2013-11-10 23:09:42 +05:30