greg/pcompress
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
pcompress/Makefile.in

181 lines
5.9 KiB
Makefile
Raw Normal View History

Initial Commit.
2012-05-28 14:49:29 +00:00
#
# This file is a part of Pcompress, a chunked parallel multi-
# algorithm lossless compression and decompression program.
#
# Copyright (C) 2012 Moinak Ghosh. All rights reserved.
# Use is subject to license terms.
#
# This program is free software; you can redistribute it and/or
# modify it under the terms of the GNU Lesser General Public
# License as published by the Free Software Foundation; either
Update License info to LGPLv3.
2012-07-07 16:48:29 +00:00
# version 3 of the License, or (at your option) any later version.
Initial Commit.
2012-05-28 14:49:29 +00:00
#
# This program is distributed in the hope that it will be useful,
# but WITHOUT ANY WARRANTY; without even the implied warranty of
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
# Lesser General Public License for more details.
#
# moinakg@belenix.org, http://moinakg.wordpress.com/
#
# This program includes partly-modified public domain source
# code from the LZMA SDK: http://www.7-zip.org/sdk.html
#
PROG= pcompress
Add ability to adjust chunk boundary based on Rabin Fingerprinting to improve compression. Remove unnecessary checks in compression loop.
2012-06-21 14:57:05 +00:00
MAINSRCS = main.c utils.c allocator.c zlib_compress.c bzip2_compress.c \
Add support for LZ4 compression including multi-pass LZ4. Add missing Read_Adjusted() declaration, was causing a crash with 2GB chunks. Fix minor cut-paste issues in comments.
2012-07-25 15:37:36 +00:00
lzma_compress.c ppmd_compress.c adaptive_compress.c lzfx_compress.c \
Fix handling of incompressible chunks. Fix handling of various dedup failures. Add NULL compression option for dedup only compression.
2012-08-05 17:05:51 +00:00
lz4_compress.c none_compress.c
Add ability to adjust chunk boundary based on Rabin Fingerprinting to improve compression. Remove unnecessary checks in compression loop.
2012-06-21 14:57:05 +00:00
MAINHDRS = allocator.h pcompress.h utils.h
Initial Commit.
2012-05-28 14:49:29 +00:00
MAINOBJS = $(MAINSRCS:.c=.o)
Add ability to adjust chunk boundary based on Rabin Fingerprinting to improve compression. Remove unnecessary checks in compression loop.
2012-06-21 14:57:05 +00:00
RABINSRCS = rabin/rabin_polynomial.c
RABINHDRS = rabin/rabin_polynomial.h utils.h
RABINOBJS = $(RABINSRCS:.c=.o)
Implement Delta Encoding based on modified bsdiff. Change to more accurate Sketch value computation approach.
2012-07-19 16:11:07 +00:00
BSDIFFSRCS = bsdiff/bsdiff.c bsdiff/bspatch.c bsdiff/rle_encoder.c
BSDIFFHDRS = bsdiff/bscommon.h utils.h allocator.h
BSDIFFOBJS = $(BSDIFFSRCS:.c=.o)
Add multithreaded LZMA port from p7zip Compute balanced thread count between chunk threads and algo threads Generic way to handle querying algorithm parameters Clean up unnecessary includes
2012-08-18 04:50:52 +00:00
LZMASRCS = lzma/LzmaEnc.c lzma/LzFind.c lzma/LzmaDec.c lzma/Threads.c lzma/LzFindMt.c
Add ability to adjust chunk boundary based on Rabin Fingerprinting to improve compression. Remove unnecessary checks in compression loop.
2012-06-21 14:57:05 +00:00
LZMAHDRS = lzma/CpuArch.h lzma/LzFind.h lzma/LzmaEnc.h lzma/Types.h \
Add multithreaded LZMA port from p7zip Compute balanced thread count between chunk threads and algo threads Generic way to handle querying algorithm parameters Clean up unnecessary includes
2012-08-18 04:50:52 +00:00
lzma/LzHash.h lzma/LzmaDec.h utils.h lzma/LzFindMt.h lzma/Threads.h lzma/windows.h \
lzma/Common/MyWindows.h lzma/Common/MyGuidDef.h lzma/basetyps.h
Initial Commit.
2012-05-28 14:49:29 +00:00
LZMAOBJS = $(LZMASRCS:.c=.o)
Add LZFX Compression support, a very fast lightweight compressor. Avoid a branch in the rabin loop.
2012-07-22 18:45:08 +00:00
LZFXSRCS = lzfx/lzfx.c
LZFXHDRS = lzfx/lzfx.h
LZFXOBJS = $(LZFXSRCS:.c=.o)
Add support for LZ4 compression including multi-pass LZ4. Add missing Read_Adjusted() declaration, was causing a crash with 2GB chunks. Fix minor cut-paste issues in comments.
2012-07-25 15:37:36 +00:00
LZ4SRCS = lz4/lz4.c lz4/lz4hc.c
LZ4HDRS = lz4/lz4.h lz4/lz4hc.h
LZ4OBJS = $(LZ4SRCS:.c=.o)
Initial Commit.
2012-05-28 14:49:29 +00:00
PPMDSRCS = lzma/Ppmd8.c lzma/Ppmd8Enc.c lzma/Ppmd8Dec.c
PPMDHDRS = lzma/Ppmd.h lzma/Ppmd8.h
PPMDOBJS = $(PPMDSRCS:.c=.o)
CRCSRCS = lzma/crc64_fast.c lzma/crc64_table.c
Add ability to adjust chunk boundary based on Rabin Fingerprinting to improve compression. Remove unnecessary checks in compression loop.
2012-06-21 14:57:05 +00:00
CRCHDRS = lzma/crc64_table_le.h lzma/crc64_table_be.h lzma/crc_macros.h
Initial Commit.
2012-05-28 14:49:29 +00:00
CRCOBJS = $(CRCSRCS:.c=.o)
Add LZP Pre-Compression support ported from libbsc. Add generic pre-processing wrappers for future support of other pre-processors. Clean up computation of Rabin block sizes. Compute Rabin scratch space accurately to avoid RAM wastage.
2012-08-23 17:28:44 +00:00
LZPSRCS = lzp/lzp.c
LZPHDRS = lzp/lzp.h
LZPOBJS = $(LZPSRCS:.c=.o)
Add support for Skein512 and Skein256 checksums Import Skein code from NIST CD submission Make checksum algorithms pluggable Fix handling of huge buffers (>2GB) in LZP Cleanup of some buffer sizing code Speed up CRC64 calculation in dedupe chunking
2012-08-31 17:06:06 +00:00
SKEINSRCS = crypto/skein/SHA3api_ref.c crypto/skein/skein_block.c \
crypto/skein/skein.c crypto/skein/skein_debug.c
SKEINHDRS = crypto/skein/brg_endian.h crypto/skein/SHA3api_ref.h \
crypto/skein/skein.h crypto/skein/skein_port.h crypto/skein/brg_types.h \
crypto/skein/skein_debug.h crypto/skein/skein_iv.h
SKEINOBJS = $(SKEINSRCS:.c=.o)
Add support for libbsc a high-performance block sorting compressor. Enable external algorithm threading for single chunk compressed files. Update docs.
2012-08-27 16:21:55 +00:00
LIBBSCWRAP = libbsc_compress.c
LIBBSCWRAPOBJ = libbsc_compress.o
LIBBSCDIR = @LIBBSCDIR@
LIBBSCLFLAGS = -L$(LIBBSCDIR) -lbsc
LIBBSCLIB = @LIBBSCLIB@
LIBBSCGEN_OPT = -fopenmp
LIBBSCCPPFLAGS = -I$(LIBBSCDIR)/libbsc -DENABLE_PC_LIBBSC
Add LZP Pre-Compression support ported from libbsc. Add generic pre-processing wrappers for future support of other pre-processors. Clean up computation of Rabin block sizes. Compute Rabin scratch space accurately to avoid RAM wastage.
2012-08-23 17:28:44 +00:00
BAKFILES = *~ lzma/*~ lzfx/*~ lz4/*~ rabin/*~ bsdiff/*~ lzp/*~
Initial Commit.
2012-05-28 14:49:29 +00:00
RM = rm -f
Add config script to generate Makefile based on flags. Add install target and installation readme file. A few comment changes.
2012-08-26 08:39:24 +00:00
COMMON_CPPFLAGS = -I. -I./lzma -I./lzfx -I./lz4 -I./rabin -I./bsdiff -DNODEFAULT_PROPS \
Add LZP Pre-Compression support ported from libbsc. Add generic pre-processing wrappers for future support of other pre-processors. Clean up computation of Rabin block sizes. Compute Rabin scratch space accurately to avoid RAM wastage.
2012-08-23 17:28:44 +00:00
-DFILE_OFFSET_BITS=64 -D_REENTRANT -D__USE_SSE_INTRIN__ -D_LZMA_PROB32 \
Add support for Skein512 and Skein256 checksums Import Skein code from NIST CD submission Make checksum algorithms pluggable Fix handling of huge buffers (>2GB) in LZP Cleanup of some buffer sizing code Speed up CRC64 calculation in dedupe chunking
2012-08-31 17:06:06 +00:00
-I./lzp @LIBBSCCPPFLAGS@ -I./crypto/skein
Add config script to generate Makefile based on flags. Add install target and installation readme file. A few comment changes.
2012-08-26 08:39:24 +00:00
COMMON_VEC_FLAGS = -ftree-vectorize
COMMON_LOOP_OPTFLAGS = $(VEC_FLAGS) -floop-interchange -floop-block
Add support for libbsc a high-performance block sorting compressor. Enable external algorithm threading for single chunk compressed files. Update docs.
2012-08-27 16:21:55 +00:00
LDLIBS = -ldl -lbz2 $(ZLIB_DIR) -lz -lm @LIBBSCLFLAGS@
Add LZP Pre-Compression support ported from libbsc. Add generic pre-processing wrappers for future support of other pre-processors. Clean up computation of Rabin block sizes. Compute Rabin scratch space accurately to avoid RAM wastage.
2012-08-23 17:28:44 +00:00
OBJS = $(MAINOBJS) $(LZMAOBJS) $(PPMDOBJS) $(LZFXOBJS) $(LZ4OBJS) $(CRCOBJS) \
Add support for Skein512 and Skein256 checksums Import Skein code from NIST CD submission Make checksum algorithms pluggable Fix handling of huge buffers (>2GB) in LZP Cleanup of some buffer sizing code Speed up CRC64 calculation in dedupe chunking
2012-08-31 17:06:06 +00:00
$(RABINOBJS) $(BSDIFFOBJS) $(LZPOBJS) @LIBBSCWRAPOBJ@ $(SKEINOBJS)
Initial Commit.
2012-05-28 14:49:29 +00:00
Add support for libbsc a high-performance block sorting compressor. Enable external algorithm threading for single chunk compressed files. Update docs.
2012-08-27 16:21:55 +00:00
DEBUG_LINK = g++ -m64 -pthread -msse3 @LIBBSCGEN_OPT@
Add config script to generate Makefile based on flags. Add install target and installation readme file. A few comment changes.
2012-08-26 08:39:24 +00:00
DEBUG_COMPILE = gcc -m64 -g -msse3 -c
DEBUG_COMPILE_cpp = g++ -m64 -g -msse3 -c
DEBUG_VEC_FLAGS =
DEBUG_LOOP_OPTFLAGS =
Add support for libbsc a high-performance block sorting compressor. Enable external algorithm threading for single chunk compressed files. Update docs.
2012-08-27 16:21:55 +00:00
DEBUG_GEN_OPT = -O -fno-omit-frame-pointer @LIBBSCGEN_OPT@
Add config script to generate Makefile based on flags. Add install target and installation readme file. A few comment changes.
2012-08-26 08:39:24 +00:00
DEBUG_RABIN_OPT = -O -fno-omit-frame-pointer
DEBUG_CPPFLAGS = $(COMMON_CPPFLAGS)
Add support for libbsc a high-performance block sorting compressor. Enable external algorithm threading for single chunk compressed files. Update docs.
2012-08-27 16:21:55 +00:00
RELEASE_LINK = g++ -m64 -pthread -msse3 @LIBBSCGEN_OPT@
Add config script to generate Makefile based on flags. Add install target and installation readme file. A few comment changes.
2012-08-26 08:39:24 +00:00
RELEASE_COMPILE = gcc -m64 -msse3 -c
RELEASE_COMPILE_cpp = g++ -m64 -msse3 -c
RELEASE_VEC_FLAGS = $(COMMON_VEC_FLAGS)
RELEASE_LOOP_OPTFLAGS = $(COMMON_LOOP_OPTFLAGS)
RELEASE_CPPFLAGS = $(COMMON_CPPFLAGS) -DNDEBUG
Add support for libbsc a high-performance block sorting compressor. Enable external algorithm threading for single chunk compressed files. Update docs.
2012-08-27 16:21:55 +00:00
RELEASE_GEN_OPT = -O3 @LIBBSCGEN_OPT@
Add config script to generate Makefile based on flags. Add install target and installation readme file. A few comment changes.
2012-08-26 08:39:24 +00:00
RELEASE_RABIN_OPT = -O2
NO_SLAB_CPPFLAGS = -DDEBUG_NO_SLAB
DEBUG_STATS_CPPFLAGS = -DDEBUG_STATS
LINK = @LINK@
COMPILE = @COMPILE@
COMPILE_cpp = @COMPILE_cpp@
VEC_FLAGS = @VEC_FLAGS@
LOOP_OPTFLAGS = @LOOP_OPTFLAGS@
CPPFLAGS = @CPPFLAGS@ @NO_SLAB_CPPFLAGS@ @DEBUG_STATS_CPPFLAGS@
GEN_OPT = @GEN_OPT@
RABIN_OPT = @RABIN_OPT@
PREFIX=@PREFIX@
Initial Commit.
2012-05-28 14:49:29 +00:00
all: $(PROG)
Add ability to adjust chunk boundary based on Rabin Fingerprinting to improve compression. Remove unnecessary checks in compression loop.
2012-06-21 14:57:05 +00:00
$(LZMAOBJS): $(LZMASRCS) $(LZMAHDRS)
Bias fingerprint value with occurrence counts for a better sketch Fix latent bug when calling algo deinit in decompression code Reduce diff threshold for slightly greater delta encoding Limit similar buffer size difference for less wasted diffing Change zlib compression wrapper to use faster deflateReset mechanism Reduce optimization level for Dedupe code, it goes faster
2012-08-08 17:10:58 +00:00
$(COMPILE) $(GEN_OPT) $(CPPFLAGS) $(@:.o=.c) -o $@
Initial Commit.
2012-05-28 14:49:29 +00:00
Add ability to adjust chunk boundary based on Rabin Fingerprinting to improve compression. Remove unnecessary checks in compression loop.
2012-06-21 14:57:05 +00:00
$(CRCOBJS): $(CRCSRCS) $(CRCHDRS)
Bias fingerprint value with occurrence counts for a better sketch Fix latent bug when calling algo deinit in decompression code Reduce diff threshold for slightly greater delta encoding Limit similar buffer size difference for less wasted diffing Change zlib compression wrapper to use faster deflateReset mechanism Reduce optimization level for Dedupe code, it goes faster
2012-08-08 17:10:58 +00:00
$(COMPILE) $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Initial Commit.
2012-05-28 14:49:29 +00:00
$(PPMDOBJS): $(PPMDSRCS) $(PPMDHDRS)
Bias fingerprint value with occurrence counts for a better sketch Fix latent bug when calling algo deinit in decompression code Reduce diff threshold for slightly greater delta encoding Limit similar buffer size difference for less wasted diffing Change zlib compression wrapper to use faster deflateReset mechanism Reduce optimization level for Dedupe code, it goes faster
2012-08-08 17:10:58 +00:00
$(COMPILE) $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Initial Commit.
2012-05-28 14:49:29 +00:00
Add ability to adjust chunk boundary based on Rabin Fingerprinting to improve compression. Remove unnecessary checks in compression loop.
2012-06-21 14:57:05 +00:00
$(RABINOBJS): $(RABINSRCS) $(RABINHDRS)
Bias fingerprint value with occurrence counts for a better sketch Fix latent bug when calling algo deinit in decompression code Reduce diff threshold for slightly greater delta encoding Limit similar buffer size difference for less wasted diffing Change zlib compression wrapper to use faster deflateReset mechanism Reduce optimization level for Dedupe code, it goes faster
2012-08-08 17:10:58 +00:00
$(COMPILE) $(RABIN_OPT) $(VEC_FLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Add ability to adjust chunk boundary based on Rabin Fingerprinting to improve compression. Remove unnecessary checks in compression loop.
2012-06-21 14:57:05 +00:00
Implement Delta Encoding based on modified bsdiff. Change to more accurate Sketch value computation approach.
2012-07-19 16:11:07 +00:00
$(BSDIFFOBJS): $(BSDIFFSRCS) $(BSDIFFHDRS)
Bias fingerprint value with occurrence counts for a better sketch Fix latent bug when calling algo deinit in decompression code Reduce diff threshold for slightly greater delta encoding Limit similar buffer size difference for less wasted diffing Change zlib compression wrapper to use faster deflateReset mechanism Reduce optimization level for Dedupe code, it goes faster
2012-08-08 17:10:58 +00:00
$(COMPILE) $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Implement Delta Encoding based on modified bsdiff. Change to more accurate Sketch value computation approach.
2012-07-19 16:11:07 +00:00
Add LZFX Compression support, a very fast lightweight compressor. Avoid a branch in the rabin loop.
2012-07-22 18:45:08 +00:00
$(LZFXOBJS): $(LZFXSRCS) $(LZFXHDRS)
Bias fingerprint value with occurrence counts for a better sketch Fix latent bug when calling algo deinit in decompression code Reduce diff threshold for slightly greater delta encoding Limit similar buffer size difference for less wasted diffing Change zlib compression wrapper to use faster deflateReset mechanism Reduce optimization level for Dedupe code, it goes faster
2012-08-08 17:10:58 +00:00
$(COMPILE) $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Add support for LZ4 compression including multi-pass LZ4. Add missing Read_Adjusted() declaration, was causing a crash with 2GB chunks. Fix minor cut-paste issues in comments.
2012-07-25 15:37:36 +00:00
$(LZ4OBJS): $(LZ4SRCS) $(LZ4HDRS)
Bias fingerprint value with occurrence counts for a better sketch Fix latent bug when calling algo deinit in decompression code Reduce diff threshold for slightly greater delta encoding Limit similar buffer size difference for less wasted diffing Change zlib compression wrapper to use faster deflateReset mechanism Reduce optimization level for Dedupe code, it goes faster
2012-08-08 17:10:58 +00:00
$(COMPILE) $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Add LZFX Compression support, a very fast lightweight compressor. Avoid a branch in the rabin loop.
2012-07-22 18:45:08 +00:00
Add LZP Pre-Compression support ported from libbsc. Add generic pre-processing wrappers for future support of other pre-processors. Clean up computation of Rabin block sizes. Compute Rabin scratch space accurately to avoid RAM wastage.
2012-08-23 17:28:44 +00:00
$(LZPOBJS): $(LZPSRCS) $(LZPHDRS)
$(COMPILE) $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Add support for Skein512 and Skein256 checksums Import Skein code from NIST CD submission Make checksum algorithms pluggable Fix handling of huge buffers (>2GB) in LZP Cleanup of some buffer sizing code Speed up CRC64 calculation in dedupe chunking
2012-08-31 17:06:06 +00:00
$(SKEINOBJS): $(SKEINSRCS) $(SKEINHDRS)
$(COMPILE) $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Add support for libbsc a high-performance block sorting compressor. Enable external algorithm threading for single chunk compressed files. Update docs.
2012-08-27 16:21:55 +00:00
$(LIBBSCLIB):
(cd $(LIBBSCDIR); make)
$(LIBBSCWRAPOBJ): $(LIBBSCWRAP) $(LIBBSCLIB)
$(COMPILE) $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Add ability to adjust chunk boundary based on Rabin Fingerprinting to improve compression. Remove unnecessary checks in compression loop.
2012-06-21 14:57:05 +00:00
$(MAINOBJS): $(MAINSRCS) $(MAINHDRS)
Bias fingerprint value with occurrence counts for a better sketch Fix latent bug when calling algo deinit in decompression code Reduce diff threshold for slightly greater delta encoding Limit similar buffer size difference for less wasted diffing Change zlib compression wrapper to use faster deflateReset mechanism Reduce optimization level for Dedupe code, it goes faster
2012-08-08 17:10:58 +00:00
$(COMPILE) $(GEN_OPT) $(LOOP_OPTFLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Initial Commit.
2012-05-28 14:49:29 +00:00
Add LZP Pre-Compression support ported from libbsc. Add generic pre-processing wrappers for future support of other pre-processors. Clean up computation of Rabin block sizes. Compute Rabin scratch space accurately to avoid RAM wastage.
2012-08-23 17:28:44 +00:00
$(PROG): $(OBJS)
$(LINK) -o $@ $(OBJS) $(LDLIBS)
Initial Commit.
2012-05-28 14:49:29 +00:00
clean:
Add LZP Pre-Compression support ported from libbsc. Add generic pre-processing wrappers for future support of other pre-processors. Clean up computation of Rabin block sizes. Compute Rabin scratch space accurately to avoid RAM wastage.
2012-08-23 17:28:44 +00:00
$(RM) $(PROG) $(OBJS) $(BAKFILES)
Initial Commit.
2012-05-28 14:49:29 +00:00
Add config script to generate Makefile based on flags. Add install target and installation readme file. A few comment changes.
2012-08-26 08:39:24 +00:00
distclean: clean
$(RM) Makefile
install: $(PROG)
@mkdir -p $(PREFIX)/bin
@chmod 0755 $(PREFIX)/bin
@cp $(PROG) $(PREFIX)/bin
@chmod 0555 $(PREFIX)/bin/$(PROG)
@mkdir -p $(PREFIX)/share/doc/$(PROG)
@chmod 0755 $(PREFIX)/share $(PREFIX)/share/doc $(PREFIX)/share/doc/$(PROG)
@cp README.md $(PREFIX)/share/doc/$(PROG)/README
@chmod 0444 $(PREFIX)/share/doc/$(PROG)/README
Reference in a new issue Copy permalink