greg/pcompress
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
pcompress/Makefile.in

446 lines
18 KiB
Makefile
Raw Normal View History

Initial Commit.
2012-05-28 14:49:29 +00:00
#
# This file is a part of Pcompress, a chunked parallel multi-
# algorithm lossless compression and decompression program.
#
Major License text cleanup.
2013-03-07 14:56:48 +00:00
# Copyright (C) 2012-2013 Moinak Ghosh. All rights reserved.
Initial Commit.
2012-05-28 14:49:29 +00:00
# Use is subject to license terms.
#
# This program is free software; you can redistribute it and/or
# modify it under the terms of the GNU Lesser General Public
# License as published by the Free Software Foundation; either
Update License info to LGPLv3.
2012-07-07 16:48:29 +00:00
# version 3 of the License, or (at your option) any later version.
Initial Commit.
2012-05-28 14:49:29 +00:00
#
# This program is distributed in the hope that it will be useful,
# but WITHOUT ANY WARRANTY; without even the implied warranty of
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
# Lesser General Public License for more details.
#
Major License text cleanup.
2013-03-07 14:56:48 +00:00
# You should have received a copy of the GNU Lesser General Public
# License along with this program.
# If not, see <http://www.gnu.org/licenses/>.
Initial Commit.
2012-05-28 14:49:29 +00:00
#
Major License text cleanup.
2013-03-07 14:56:48 +00:00
# moinakg@belenix.org, http://moinakg.wordpress.com/
Initial Commit.
2012-05-28 14:49:29 +00:00
#
PROG= pcompress
Some initial tidbits for the start of an OSX/Windows port.
2014-04-26 17:35:14 +00:00
SO_SUFFIX=@SO_SUFFIX@
LIB=libpcompress.$(SO_SUFFIX)
Make Pcompress functionality into a library - initial changes.
2013-06-02 15:24:33 +00:00
LINKLIB=pcompress
Some initial tidbits for the start of an OSX/Windows port.
2014-04-26 17:35:14 +00:00
GCC=@GCC@
GPP=@GPP@
Make Pcompress functionality into a library - initial changes.
2013-06-02 15:24:33 +00:00
LIBVER=1
MAINSRCS = utils/utils.c allocator.c lzma_compress.c ppmd_compress.c \
Enable building with alternate Zlib and Bzlib. Update README and comments. Fix correct setting of output size when using Delta2 without LZP.
2012-12-16 17:47:04 +00:00
adaptive_compress.c lzfx_compress.c lz4_compress.c none_compress.c \
Add basic framework for file type based filters during libarchive stage. Add packJPG filter for Jpeg files (not active yet). Directory format changes for clarity.
2013-11-10 17:39:42 +00:00
utils/xxhash_base.c utils/heap.c utils/cpuid.c pcompress.c
Drastic simplification of Min-heap code and resultant Delta speedup.
2013-05-25 12:04:38 +00:00
MAINHDRS = allocator.h pcompress.h utils/utils.h utils/xxhash.h utils/heap.h \
Add Dispack filter with auto-detection of x86 executables in archive mode. More elaborate magic header based detection of 32-bit and 64-bit x86 binaries. Always use fast-mode LZ4 in Adaptive modes.
2013-11-24 14:15:58 +00:00
utils/cpuid.h utils/xxhash.h archive/pc_archive.h filters/dispack/dis.hpp
Initial Commit.
2012-05-28 14:49:29 +00:00
MAINOBJS = $(MAINSRCS:.c=.o)
Make Pcompress functionality into a library - initial changes.
2013-06-02 15:24:33 +00:00
PROGSRCS = main.c
PROGHDRS = pcompress.h utils/utils.h
PROGOBJS = $(PROGSRCS:.c=.o)
Add XSalsa20 encryption algorithm from the NaCL library. Include 128-bit key support based on the Salsa20 eSTREAM submission. Allow variable-length nonces. Use random bytes for initial nonce value. Increase PBE hash rounds to 50000.
2013-03-04 16:26:07 +00:00
XSALSA20_STREAM_C = crypto/xsalsa20/stream.c
XSALSA20_STREAM_ASM = crypto/xsalsa20/stream.s
XSALSA20_DEBUG = -DSALSA20_DEBUG
Enable building with alternate Zlib and Bzlib. Update README and comments. Fix correct setting of output size when using Delta2 without LZP.
2012-12-16 17:47:04 +00:00
CRYPTO_SRCS = crypto/aes/crypto_aes.c crypto/scrypt/crypto_scrypt-nosse.c \
Add parallel versions of various checksums for single-segment, single-thread compression.
2013-01-27 18:17:55 +00:00
crypto/scrypt/sha256.c crypto/scrypt/crypto_aesctr.c crypto/crypto_utils.c \
Add XSalsa20 encryption algorithm from the NaCL library. Include 128-bit key support based on the Salsa20 eSTREAM submission. Allow variable-length nonces. Use random bytes for initial nonce value. Increase PBE hash rounds to 50000.
2013-03-04 16:26:07 +00:00
crypto/sha2_utils.c crypto/sha3_utils.c crypto/xsalsa20/xsalsa20_xor.c \
crypto/xsalsa20/hsalsa_core.c @XSALSA20_STREAM_C@
Enable building with alternate Zlib and Bzlib. Update README and comments. Fix correct setting of output size when using Delta2 without LZP.
2012-12-16 17:47:04 +00:00
CRYPTO_HDRS = crypto/crypto_utils.h crypto/scrypt/crypto_scrypt.h \
crypto/scrypt/sha256.h crypto/scrypt/crypto_aesctr.h crypto/aes/crypto_aes.h \
Add XSalsa20 encryption algorithm from the NaCL library. Include 128-bit key support based on the Salsa20 eSTREAM submission. Allow variable-length nonces. Use random bytes for initial nonce value. Increase PBE hash rounds to 50000.
2013-03-04 16:26:07 +00:00
crypto/sha2_utils.h crypto/sha3_utils.h crypto/xsalsa20/crypto_core_hsalsa20.h \
crypto/xsalsa20/crypto_stream_salsa20.h crypto/xsalsa20/crypto_xsalsa20.h \
$(MAINHDRS)
CRYPTO_ASM_SRCS = crypto/aes/vpaes-x86_64.s crypto/aes/aesni-x86_64.s @XSALSA20_STREAM_ASM@
CRYPTO_ASM_OBJS = $(CRYPTO_ASM_SRCS:.s=.o)
CRYPTO_ASM_HDRS = crypto/aes/crypto_aes.h crypto/xsalsa20/crypto_stream_salsa20.h
Add compatibility to decode old-format parallel hashes created with version 1.2. Bump archive version to 7 as parallel hashes are now merkle style hashes.
2013-02-24 14:35:16 +00:00
CRYPTO_COMPAT_SRCS = crypto/old/sha2_utils_old.c crypto/old/sha3_utils_old.c
CRYPTO_COMPAT_HDRS = crypto/old/sha2_utils_old.h crypto/old/sha3_utils_old.h
Enable building with alternate Zlib and Bzlib. Update README and comments. Fix correct setting of output size when using Delta2 without LZP.
2012-12-16 17:47:04 +00:00
CRYPTO_OBJS = $(CRYPTO_SRCS:.c=.o)
Add compatibility to decode old-format parallel hashes created with version 1.2. Bump archive version to 7 as parallel hashes are now merkle style hashes.
2013-02-24 14:35:16 +00:00
CRYPTO_COMPAT_OBJS = $(CRYPTO_COMPAT_SRCS:.c=.o)
Enable building with alternate Zlib and Bzlib. Update README and comments. Fix correct setting of output size when using Delta2 without LZP.
2012-12-16 17:47:04 +00:00
CRYPTO_CPPFLAGS=-I@OPENSSL_INCDIR@
Changes for generalized runtime SSE/AVX/XOP detection. Multi instruction set XXhash build with runtime selection. Extend CPUID code to detect more instruction sets. Add options for BLAKE2 hash. Move GCC builtins into utils header. Bump file format version number due to extended digest flags. Add descriptions to digest list.
2013-01-24 18:40:12 +00:00
XXHASH_SRCS = utils/xxhash.c
XXHASH_SSE4_SRCS = utils/xxhash_sse4.c
XXHASH_SSE2_SRCS = utils/xxhash_sse2.c
XXHASH_OBJS = utils/xxhash_sse4.o utils/xxhash_sse2.o
XXHASH_HDRS = utils/xxhash.h
Add optimized BLAKE2 implementations with runtime detection of CPU capability (SSE/AVX). Minor cleanups.
2013-01-26 10:09:10 +00:00
BLAKE2b_SSE2 = crypto/blake2/blake2b_sse2.c
BLAKE2b_SSE3 = crypto/blake2/blake2b_ssse3.c
BLAKE2b_SSE4 = crypto/blake2/blake2b_sse41.c
BLAKE2b_AVX = crypto/blake2/blake2b_avx.c
BLAKE2bp_SSE2 = crypto/blake2/blake2bp_sse2.c
BLAKE2bp_SSE3 = crypto/blake2/blake2bp_ssse3.c
BLAKE2bp_SSE4 = crypto/blake2/blake2bp_sse41.c
BLAKE2bp_AVX = crypto/blake2/blake2bp_avx.c
BLAKE2_BASE_SRCS = crypto/blake2/blake2b.c crypto/blake2/blake2bp.c
BLAKE2_HDRS = crypto/blake2/blake2.h crypto/blake2/blake2-impl.h crypto/blake2/blake2-config.h \
crypto/blake2/blake2-kat.h crypto/blake2/blake2b-round.h crypto/blake2/blake2b-load-sse2.h \
crypto/blake2/blake2b-load-sse41.h
BLAKE2_SRCS = $(BLAKE2b_SSE2) $(BLAKE2b_SSE3) $(BLAKE2b_SSE4) $(BLAKE2b_AVX) \
$(BLAKE2bp_SSE2) $(BLAKE2bp_SSE3) $(BLAKE2bp_SSE4) $(BLAKE2bp_AVX)
BLAKE2_OBJS = $(BLAKE2_SRCS:.c=.o)
Enable building with alternate Zlib and Bzlib. Update README and comments. Fix correct setting of output size when using Delta2 without LZP.
2012-12-16 17:47:04 +00:00
ZLIB_SRCS = zlib_compress.c
ZLIB_HDRS = $(MAINHDRS)
ZLIB_OBJS = $(ZLIB_SRCS:.c=.o)
ZLIB_CPPFLAGS = @LIBZ_INC@
BZLIB_SRCS = bzip2_compress.c
BZLIB_HDRS = $(MAINHDRS)
BZLIB_OBJS = $(BZLIB_SRCS:.c=.o)
BZLIB_CPPFLAGS = @LIBBZ2_INC@
Work in progress changes for Segmented Global Deduplication.
2013-04-09 16:53:51 +00:00
RABINSRCS = rabin/rabin_dedup.c rabin/global/index.c rabin/global/dedupe_config.c
Add a qsort variant optimized for integers and use in global dedupe. Cleanup LZMA CRC64/32 declarations and add a header. Fix heapq header.
2013-05-03 16:36:55 +00:00
RABINHDRS = rabin/rabin_dedup.h utils/utils.h rabin/global/index.h rabin/global/dedupe_config.h lzma/lzma_crc.h utils/qsort.h
Add ability to adjust chunk boundary based on Rabin Fingerprinting to improve compression. Remove unnecessary checks in compression loop.
2012-06-21 14:57:05 +00:00
RABINOBJS = $(RABINSRCS:.c=.o)
Implement Delta Encoding based on modified bsdiff. Change to more accurate Sketch value computation approach.
2012-07-19 16:11:07 +00:00
BSDIFFSRCS = bsdiff/bsdiff.c bsdiff/bspatch.c bsdiff/rle_encoder.c
Add xxHash for Rabin block checksums, slightly faster than CRC64. Fix missing initialization of character counts table. Some file reorganization.
2012-09-02 15:10:32 +00:00
BSDIFFHDRS = bsdiff/bscommon.h utils/utils.h allocator.h
Implement Delta Encoding based on modified bsdiff. Change to more accurate Sketch value computation approach.
2012-07-19 16:11:07 +00:00
BSDIFFOBJS = $(BSDIFFSRCS:.c=.o)
Add multithreaded LZMA port from p7zip Compute balanced thread count between chunk threads and algo threads Generic way to handle querying algorithm parameters Clean up unnecessary includes
2012-08-18 04:50:52 +00:00
LZMASRCS = lzma/LzmaEnc.c lzma/LzFind.c lzma/LzmaDec.c lzma/Threads.c lzma/LzFindMt.c
Add ability to adjust chunk boundary based on Rabin Fingerprinting to improve compression. Remove unnecessary checks in compression loop.
2012-06-21 14:57:05 +00:00
LZMAHDRS = lzma/CpuArch.h lzma/LzFind.h lzma/LzmaEnc.h lzma/Types.h \
Add xxHash for Rabin block checksums, slightly faster than CRC64. Fix missing initialization of character counts table. Some file reorganization.
2012-09-02 15:10:32 +00:00
lzma/LzHash.h lzma/LzmaDec.h utils/utils.h lzma/LzFindMt.h lzma/Threads.h lzma/windows.h \
Add multithreaded LZMA port from p7zip Compute balanced thread count between chunk threads and algo threads Generic way to handle querying algorithm parameters Clean up unnecessary includes
2012-08-18 04:50:52 +00:00
lzma/Common/MyWindows.h lzma/Common/MyGuidDef.h lzma/basetyps.h
Initial Commit.
2012-05-28 14:49:29 +00:00
LZMAOBJS = $(LZMASRCS:.c=.o)
Add LZFX Compression support, a very fast lightweight compressor. Avoid a branch in the rabin loop.
2012-07-22 18:45:08 +00:00
LZFXSRCS = lzfx/lzfx.c
LZFXHDRS = lzfx/lzfx.h
LZFXOBJS = $(LZFXSRCS:.c=.o)
Add support for LZ4 compression including multi-pass LZ4. Add missing Read_Adjusted() declaration, was causing a crash with 2GB chunks. Fix minor cut-paste issues in comments.
2012-07-25 15:37:36 +00:00
LZ4SRCS = lz4/lz4.c lz4/lz4hc.c
LZ4HDRS = lz4/lz4.h lz4/lz4hc.h
LZ4OBJS = $(LZ4SRCS:.c=.o)
Initial Commit.
2012-05-28 14:49:29 +00:00
PPMDSRCS = lzma/Ppmd8.c lzma/Ppmd8Enc.c lzma/Ppmd8Dec.c
PPMDHDRS = lzma/Ppmd.h lzma/Ppmd8.h
PPMDOBJS = $(PPMDSRCS:.c=.o)
Add CRC32 header checksums in non-cryptographic mode.
2012-11-22 18:30:39 +00:00
CRCSRCS = lzma/crc64_fast.c lzma/crc64_table.c lzma/crc32_fast.c lzma/crc32_table.c
CRCHDRS = lzma/crc64_table_le.h lzma/crc64_table_be.h lzma/crc_macros.h \
Add a qsort variant optimized for integers and use in global dedupe. Cleanup LZMA CRC64/32 declarations and add a header. Fix heapq header.
2013-05-03 16:36:55 +00:00
lzma/crc32_table_le.h lzma/crc32_table_be.h lzma/lzma_crc.h
Initial Commit.
2012-05-28 14:49:29 +00:00
CRCOBJS = $(CRCSRCS:.c=.o)
Add basic framework for file type based filters during libarchive stage. Add packJPG filter for Jpeg files (not active yet). Directory format changes for clarity.
2013-11-10 17:39:42 +00:00
LZPSRCS = filters/lzp/lzp.c
LZPHDRS = filters/lzp/lzp.h
Add LZP Pre-Compression support ported from libbsc. Add generic pre-processing wrappers for future support of other pre-processors. Clean up computation of Rabin block sizes. Compute Rabin scratch space accurately to avoid RAM wastage.
2012-08-23 17:28:44 +00:00
LZPOBJS = $(LZPSRCS:.c=.o)
Add basic framework for file type based filters during libarchive stage. Add packJPG filter for Jpeg files (not active yet). Directory format changes for clarity.
2013-11-10 17:39:42 +00:00
DELTA2SRCS = filters/delta2/delta2.c
DELTA2HDRS = filters/delta2/delta2.h
Implement Adaptive Delta Encoding.
2012-12-04 18:39:47 +00:00
DELTA2OBJS = $(DELTA2SRCS:.c=.o)
Add basic framework for file type based filters during libarchive stage. Add packJPG filter for Jpeg files (not active yet). Directory format changes for clarity.
2013-11-10 17:39:42 +00:00
ARCHIVESRCS = archive/pc_archive.c archive/pc_arc_filter.c utils/phash/phash.c \
utils/phash/lookupa.c utils/phash/recycle.c
ARCHIVEHDRS = pcompress.h utils/utils.h archive/pc_archive.h utils/phash/standard.h \
Use libbsc/ppmd for BMP files. Fix extension based hashing. Do not append .pz extension to filenames already having it. Some code formatting changes.
2013-11-28 17:12:51 +00:00
utils/phash/lookupa.h utils/phash/recycle.h utils/phash/phash.h archive/pc_arc_filter.h \
utils/phash/extensions.h
Add basic framework for file type based filters during libarchive stage. Add packJPG filter for Jpeg files (not active yet). Directory format changes for clarity.
2013-11-10 17:39:42 +00:00
ARCHIVEOBJS = $(ARCHIVESRCS:.c=.o)
PJPGSRCS = filters/packjpg/aricoder.cpp filters/packjpg/bitops.cpp filters/packjpg/packjpg.cpp \
archive/pjpg_helper.cpp
PJPGHDRS = filters/packjpg/aricoder.h filters/packjpg/bitops.h filters/packjpg/dct8x8.h \
filters/packjpg/packjpglib.h filters/packjpg/pjpgtbl.h
PJPGOBJS = $(PJPGSRCS:.cpp=.o)
Pull in private copy of libarchive to add pcmpress-specific functionality. First step to add packPNM support.
2014-09-11 13:04:43 +00:00
PPNMSRCS = filters/packpnm/packpnm.cpp archive/ppnm_helper.cpp
PPNMHDRS = filters/packjpg/aricoder.h filters/packjpg/bitops.h filters/packpnm/ppnmbitlen.h \
filters/packpnm/packpnmlib.h filters/packpnm/ppnmtbl.h
PPNMOBJS = $(PPNMSRCS:.cpp=.o)
Add Dispack filter with auto-detection of x86 executables in archive mode. More elaborate magic header based detection of 32-bit and 64-bit x86 binaries. Always use fast-mode LZ4 in Adaptive modes.
2013-11-24 14:15:58 +00:00
DISPACKSRCS = filters/dispack/dis.cpp
DISPACKHDRS = filters/dispack/dis.hpp filters/dispack/types.hpp
DISPACKOBJS = $(DISPACKSRCS:.cpp=.o)
Add ASM version of Skein for x64 platforms with auto-detection Error checking for checksum flag when decompressing Update comments and READMEs
2012-09-01 09:10:15 +00:00
SKEIN_BLOCK_C = crypto/skein/skein_block.c
SKEIN_BLOCK_ASM = crypto/skein/skein_block_x64.s
SKEIN_BLOCK_SRC = @SKEIN_BLOCK@
SKEIN_BLOCK_OBJ = crypto/skein/skein_block.o
SKEINSRCS = crypto/skein/SHA3api_ref.c crypto/skein/skein.c crypto/skein/skein_debug.c
Add support for Skein512 and Skein256 checksums Import Skein code from NIST CD submission Make checksum algorithms pluggable Fix handling of huge buffers (>2GB) in LZP Cleanup of some buffer sizing code Speed up CRC64 calculation in dedupe chunking
2012-08-31 17:06:06 +00:00
SKEINHDRS = crypto/skein/brg_endian.h crypto/skein/SHA3api_ref.h \
crypto/skein/skein.h crypto/skein/skein_port.h crypto/skein/brg_types.h \
crypto/skein/skein_debug.h crypto/skein/skein_iv.h
SKEINOBJS = $(SKEINSRCS:.c=.o)
Major changes to use Intel's optimized SHA512 code for SHA512 and SHA512/256. Remove earlier SHA256 code which is slower than SHA512/256 (on 64-bit CPU). Use HMAC from Alan Saddi's implementation for cleaner, faster code.
2013-01-25 17:25:55 +00:00
SHA2_SRCS = crypto/sha2/sha512.c
SHA2_HDRS = crypto/sha2/sha512.h
SHA2ASM_SRCS = crypto/sha2/intel/sha512_avx.asm crypto/sha2/intel/sha512_sse4.asm
SHA2ASM_OBJS = $(SHA2ASM_SRCS:.asm=.o)
SHA2_OBJS = $(SHA2_SRCS:.c=.o)
Incorporate SSE/AVX optimized Intel SHA-256 implementation. Add support for runtime cpuid detection.
2012-10-06 15:21:23 +00:00
More portability tweaks. Handle platform specific yasm parameters. Resolve namespace conflict on OSX. Do not build Skein ASM code on OSX.
2014-04-30 17:16:24 +00:00
YASM = @YASM@
More portability tweaks. Fix compiler warnings.
2014-05-04 08:02:11 +00:00
YASM_GAS = @YASM_GAS@
Add support for libbsc a high-performance block sorting compressor. Enable external algorithm threading for single chunk compressed files. Update docs.
2012-08-27 16:21:55 +00:00
LIBBSCWRAP = libbsc_compress.c
LIBBSCWRAPOBJ = libbsc_compress.o
LIBBSCDIR = @LIBBSCDIR@
LIBBSCLFLAGS = -L$(LIBBSCDIR) -lbsc
LIBBSCLIB = @LIBBSCLIB@
LIBBSCGEN_OPT = -fopenmp
LIBBSCCPPFLAGS = -I$(LIBBSCDIR)/libbsc -DENABLE_PC_LIBBSC
Add basic framework for file type based filters during libarchive stage. Add packJPG filter for Jpeg files (not active yet). Directory format changes for clarity.
2013-11-10 17:39:42 +00:00
TRANSP_SRCS = filters/transpose/transpose.c
TRANSP_HDRS = filters/transpose/transpose.h
Add Matrix Transpose of Dedupe index to compress it better. Fix handling of Dedupe index compression failure.
2012-12-12 18:30:47 +00:00
TRANSP_OBJS = $(TRANSP_SRCS:.c=.o)
Add support for 64-bit Keccak implementation. Sanitize error message from tests. Add more tests. Improve platform detection in config script.
2012-12-08 08:49:01 +00:00
KECCAK_SRC_COMMON = crypto/keccak/genKAT.c crypto/keccak/KeccakDuplex.c \
crypto/keccak/KeccakNISTInterface.c crypto/keccak/KeccakSponge.c
KECCAK_SRC_OPT64 = $(KECCAK_SRC_COMMON) crypto/keccak/KeccakF-1600-opt64.c
KECCAK_SRC_OPT64_ASM1 = $(KECCAK_SRC_COMMON) crypto/keccak/KeccakF-1600-x86-64-asm.c
KECCAK_SRC_OPT64_ASM2 = crypto/keccak/KeccakF-1600-x86-64-gas.s
More portability tweaks.
2014-05-04 06:24:33 +00:00
KECCAK_SRC_OPT64_ASM3 = crypto/keccak/KeccakF-1600-x86-64-gas_yasm.s
KECCAK_OBJS_OPT64_ASM2 = $(KECCAK_SRC_OPT64_ASM2:.s=.o)
KECCAK_OBJS_OPT64_ASM3 = $(KECCAK_SRC_OPT64_ASM3:.s=.o)
Add support for 64-bit Keccak implementation. Sanitize error message from tests. Add more tests. Improve platform detection in config script.
2012-12-08 08:49:01 +00:00
KECCAK_HDRS_COMMON = crypto/keccak/KeccakDuplex.h crypto/keccak/KeccakNISTInterface.h \
crypto/keccak/KeccakSponge.h crypto/keccak/KeccakF-1600-interface.h
KECCAK_HDRS_OPT = $(KECCAK_HDRS_COMMON) \
crypto/keccak/brg_endian.h crypto/keccak/KeccakF-1600-unrolling.macros
KECCAK_HDRS_OPT64 = $(KECCAK_HDRS_OPT) crypto/keccak/KeccakF-1600-opt64-settings.h \
crypto/keccak/KeccakF-1600-64.macros crypto/keccak/KeccakF-1600-simd64.macros \
crypto/keccak/KeccakF-1600-simd128.macros
KECCAK_HDRS_OPT64_ASM = $(KECCAK_HDRS_OPT64)
KECCAK_SRCS = @KECCAK_SRCS@
KECCAK_SRCS_ASM = @KECCAK_SRCS_ASM@
KECCAK_HDRS = @KECCAK_HDRS@
KECCAK_OBJS = $(KECCAK_SRCS:.c=.o)
KECCAK_OBJS_ASM = $(KECCAK_SRCS_ASM:.s=.o)
More portability tweaks.
2014-05-04 06:24:33 +00:00
CRYPTO_ASM_COMPILE1 = $(COMPILE) $(GEN_OPT) $(CRYPTO_CPPFLAGS) $(CPPFLAGS)
More portability tweaks. Fix compiler warnings.
2014-05-04 08:02:11 +00:00
CRYPTO_ASM_COMPILE2 = $(YASM_GAS)
More portability tweaks.
2014-05-04 06:24:33 +00:00
CRYPTO_ASM_COMPILE = @CRYPTO_ASM_COMPILE@
Add basic framework for file type based filters during libarchive stage. Add packJPG filter for Jpeg files (not active yet). Directory format changes for clarity.
2013-11-10 17:39:42 +00:00
BAKFILES = *~ lzma/*~ lzfx/*~ lz4/*~ rabin/*~ bsdiff/*~ filters/lzp/*~ utils/*~ crypto/sha2/*~ \
Add adaptive delta encoding test.
2012-12-05 16:33:09 +00:00
crypto/sha2/intel/*~ crypto/aes/*~ crypto/scrypt/*~ crypto/*~ rabin/global/*~ \
Archiving support using Libarchive: Work in progress changes. Change all perror() calls to use logger. Make the config script a little verbose.
2013-10-20 18:24:27 +00:00
delta2/*~ crypto/keccak/*~ transpose/*~ crypto/skein/*~ crypto/keccak/*.o \
Add basic framework for file type based filters during libarchive stage. Add packJPG filter for Jpeg files (not active yet). Directory format changes for clarity.
2013-11-10 17:39:42 +00:00
archive/*~ filters/delta2/*~ filters/packjpg/*~ filters/transpose/*~
Initial Commit.
2012-05-28 14:49:29 +00:00
RM = rm -f
Add a functionality test suite.
2012-11-08 16:52:37 +00:00
RM_RF = rm -rf
Add basic framework for file type based filters during libarchive stage. Add packJPG filter for Jpeg files (not active yet). Directory format changes for clarity.
2013-11-10 17:39:42 +00:00
BASE_CPPFLAGS = -I. -I./lzma -I./lzfx -I./lz4 -I./rabin -I./bsdiff -DNODEFAULT_PROPS \
Add LZP Pre-Compression support ported from libbsc. Add generic pre-processing wrappers for future support of other pre-processors. Clean up computation of Rabin block sizes. Compute Rabin scratch space accurately to avoid RAM wastage.
2012-08-23 17:28:44 +00:00
-DFILE_OFFSET_BITS=64 -D_REENTRANT -D__USE_SSE_INTRIN__ -D_LZMA_PROB32 \
Add basic framework for file type based filters during libarchive stage. Add packJPG filter for Jpeg files (not active yet). Directory format changes for clarity.
2013-11-10 17:39:42 +00:00
-I./filters/lzp @LIBBSCCPPFLAGS@ -I./crypto/skein -I./utils -I./crypto/sha2 \
Add lookup and insert functionality for global index. Make global dedupe code buildable.
2013-02-21 17:37:07 +00:00
-I./crypto/scrypt -I./crypto/aes -I./crypto @KEYLEN@ -I./rabin/global \
Add basic framework for file type based filters during libarchive stage. Add packJPG filter for Jpeg files (not active yet). Directory format changes for clarity.
2013-11-10 17:39:42 +00:00
-I./crypto/keccak -I./filters/transpose -I./crypto/blake2 $(EXTRA_CPPFLAGS) \
-I./crypto/xsalsa20 -I./archive -pedantic -Wall -I./filters -fno-strict-aliasing \
-Wno-unused-but-set-variable -Wno-enum-compare \
Pull in private copy of libarchive to add pcmpress-specific functionality. First step to add packPNM support.
2014-09-11 13:04:43 +00:00
@COMPAT_CPPFLAGS@ @XSALSA20_DEBUG@ -I@LIBARCHIVE_DIR@/libarchive -I./filters/packjpg \
-I./filters/packpnm
Part 1 changes to allow dual licensing to MPLV2. Make external LGPL code/features disabled in MPLV2 variant. Nuke some unwanted whitespace (cstyle).
2014-07-24 16:50:30 +00:00
COMMON_CPPFLAGS = $(BASE_CPPFLAGS) -std=gnu99
Add basic framework for file type based filters during libarchive stage. Add packJPG filter for Jpeg files (not active yet). Directory format changes for clarity.
2013-11-10 17:39:42 +00:00
COMMON_CPPFLAGS_cpp = $(BASE_CPPFLAGS)
Add config script to generate Makefile based on flags. Add install target and installation readme file. A few comment changes.
2012-08-26 08:39:24 +00:00
COMMON_VEC_FLAGS = -ftree-vectorize
COMMON_LOOP_OPTFLAGS = $(VEC_FLAGS) -floop-interchange -floop-block
More portability tweaks. Fix compiler warnings.
2014-05-04 08:02:11 +00:00
RPATH=@RPATH@
DTAGS=@DTAGS@
Pull in private copy of libarchive to add pcmpress-specific functionality. First step to add packPNM support.
2014-09-11 13:04:43 +00:00
LDLIBS = -ldl -liconv -L./buildtmp -Wl,$(RPATH)@LIBBZ2_DIR@ -lbz2 -L./buildtmp -Wl,$(RPATH)@LIBZ_DIR@ -lz -lm @LIBBSCLFLAGS@ \
-L./buildtmp -Wl,$(RPATH)@OPENSSL_LIBDIR@ -lcrypto @LRT@ -L@LIBARCHIVE_DIR@/.libs -larchive $(EXTRA_LDFLAGS) \
More portability tweaks. Fix compiler warnings.
2014-05-04 08:02:11 +00:00
-Wl,$(RPATH)/usr/lib$(DTAGS) -Wl,$(RPATH)/usr/lib64$(DTAGS)
Add LZP Pre-Compression support ported from libbsc. Add generic pre-processing wrappers for future support of other pre-processors. Clean up computation of Rabin block sizes. Compute Rabin scratch space accurately to avoid RAM wastage.
2012-08-23 17:28:44 +00:00
OBJS = $(MAINOBJS) $(LZMAOBJS) $(PPMDOBJS) $(LZFXOBJS) $(LZ4OBJS) $(CRCOBJS) \
Implement Adaptive Delta Encoding.
2012-12-04 18:39:47 +00:00
$(RABINOBJS) $(BSDIFFOBJS) $(LZPOBJS) $(DELTA2OBJS) @LIBBSCWRAPOBJ@ $(SKEINOBJS) \
Major changes to use Intel's optimized SHA512 code for SHA512 and SHA512/256. Remove earlier SHA256 code which is slower than SHA512/256 (on 64-bit CPU). Use HMAC from Alan Saddi's implementation for cleaner, faster code.
2013-01-25 17:25:55 +00:00
$(SKEIN_BLOCK_OBJ) @SHA2ASM_OBJS@ @SHA2_OBJS@ $(KECCAK_OBJS) $(KECCAK_OBJS_ASM) \
Add compatibility to decode old-format parallel hashes created with version 1.2. Bump archive version to 7 as parallel hashes are now merkle style hashes.
2013-02-24 14:35:16 +00:00
$(TRANSP_OBJS) $(CRYPTO_OBJS) $(ZLIB_OBJS) $(BZLIB_OBJS) $(XXHASH_OBJS) $(BLAKE2_OBJS) \
Pull in private copy of libarchive to add pcmpress-specific functionality. First step to add packPNM support.
2014-09-11 13:04:43 +00:00
@CRYPTO_COMPAT_OBJS@ $(CRYPTO_ASM_OBJS) $(ARCHIVEOBJS) $(PJPGOBJS) $(DISPACKOBJS) $(PPNMOBJS)
Initial Commit.
2012-05-28 14:49:29 +00:00
Some initial tidbits for the start of an OSX/Windows port.
2014-04-26 17:35:14 +00:00
DEBUG_LINK = $(GPP) -pthread @LIBBSCGEN_OPT@ @EXTRA_OPT_FLAGS@ -fopenmp -fPIC
Add AVX detection and usage of -mavx[2] flags. Force GCC to use Clang assembler always on MAC OS X for AVX support.
2014-05-04 16:33:40 +00:00
DEBUG_COMPILE = $(GCC) -g -c @EXTRA_OPT_FLAGS@ -fPIC @USE_CLANG_AS@
DEBUG_COMPILE_cpp = $(GPP) -g -c @EXTRA_OPT_FLAGS@ -fPIC @USE_CLANG_AS@
Add config script to generate Makefile based on flags. Add install target and installation readme file. A few comment changes.
2012-08-26 08:39:24 +00:00
DEBUG_VEC_FLAGS =
DEBUG_LOOP_OPTFLAGS =
Add optimized BLAKE2 implementations with runtime detection of CPU capability (SSE/AVX). Minor cleanups.
2013-01-26 10:09:10 +00:00
DEBUG_GEN_OPT = -O -fno-omit-frame-pointer @LIBBSCGEN_OPT@ -fopenmp
Add config script to generate Makefile based on flags. Add install target and installation readme file. A few comment changes.
2012-08-26 08:39:24 +00:00
DEBUG_CPPFLAGS = $(COMMON_CPPFLAGS)
Add support for 64-bit Keccak implementation. Sanitize error message from tests. Add more tests. Improve platform detection in config script.
2012-12-08 08:49:01 +00:00
DEBUG_FPTR_FLAG =
Add config script to generate Makefile based on flags. Add install target and installation readme file. A few comment changes.
2012-08-26 08:39:24 +00:00
Some initial tidbits for the start of an OSX/Windows port.
2014-04-26 17:35:14 +00:00
RELEASE_LINK = $(GPP) -pthread @LIBBSCGEN_OPT@ @EXTRA_OPT_FLAGS@ -fopenmp -fPIC
Add AVX detection and usage of -mavx[2] flags. Force GCC to use Clang assembler always on MAC OS X for AVX support.
2014-05-04 16:33:40 +00:00
RELEASE_COMPILE = $(GCC) -c @EXTRA_OPT_FLAGS@ -fPIC -fvisibility=hidden @USE_CLANG_AS@
RELEASE_COMPILE_cpp = $(GPP) -c @EXTRA_OPT_FLAGS@ -fPIC -fvisibility=hidden @USE_CLANG_AS@
Add config script to generate Makefile based on flags. Add install target and installation readme file. A few comment changes.
2012-08-26 08:39:24 +00:00
RELEASE_VEC_FLAGS = $(COMMON_VEC_FLAGS)
RELEASE_LOOP_OPTFLAGS = $(COMMON_LOOP_OPTFLAGS)
RELEASE_CPPFLAGS = $(COMMON_CPPFLAGS) -DNDEBUG
Add optimized BLAKE2 implementations with runtime detection of CPU capability (SSE/AVX). Minor cleanups.
2013-01-26 10:09:10 +00:00
RELEASE_GEN_OPT = -O3 @LIBBSCGEN_OPT@ -fopenmp
Add support for 64-bit Keccak implementation. Sanitize error message from tests. Add more tests. Improve platform detection in config script.
2012-12-08 08:49:01 +00:00
RELEASE_FPTR_FLAG = -fomit-frame-pointer
Add config script to generate Makefile based on flags. Add install target and installation readme file. A few comment changes.
2012-08-26 08:39:24 +00:00
NO_SLAB_CPPFLAGS = -DDEBUG_NO_SLAB
DEBUG_STATS_CPPFLAGS = -DDEBUG_STATS
Make Pcompress functionality into a library - initial changes.
2013-06-02 15:24:33 +00:00
LINK.PROG = @LINK@
LINK.LIB = @LINK@ -shared
Add config script to generate Makefile based on flags. Add install target and installation readme file. A few comment changes.
2012-08-26 08:39:24 +00:00
COMPILE = @COMPILE@
COMPILE_cpp = @COMPILE_cpp@
VEC_FLAGS = @VEC_FLAGS@
LOOP_OPTFLAGS = @LOOP_OPTFLAGS@
CPPFLAGS = @CPPFLAGS@ @NO_SLAB_CPPFLAGS@ @DEBUG_STATS_CPPFLAGS@
Changes for generalized runtime SSE/AVX/XOP detection. Multi instruction set XXhash build with runtime selection. Extend CPUID code to detect more instruction sets. Add options for BLAKE2 hash. Move GCC builtins into utils header. Bump file format version number due to extended digest flags. Add descriptions to digest list.
2013-01-24 18:40:12 +00:00
GEN_OPT = @GEN_OPT@ @SSE_OPT_FLAGS@
BASE_OPT = @GEN_OPT@
Add config script to generate Makefile based on flags. Add install target and installation readme file. A few comment changes.
2012-08-26 08:39:24 +00:00
PREFIX=@PREFIX@
More portability tweaks. Fix compiler warnings.
2014-05-04 08:02:11 +00:00
AVX_OPT_FLAG = -mavx @USE_CLANG_AS@
SSE4_OPT_FLAG = -msse4.2 @USE_CLANG_AS@
SSE3_OPT_FLAG = -mssse3 @USE_CLANG_AS@
SSE2_OPT_FLAG = -msse2 @USE_CLANG_AS@
Initial Commit.
2012-05-28 14:49:29 +00:00
Add support for 64-bit Keccak implementation. Sanitize error message from tests. Add more tests. Improve platform detection in config script.
2012-12-08 08:49:01 +00:00
SKEIN_FLAGS = $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) @FPTR_FLAG@
Major changes to use Intel's optimized SHA512 code for SHA512 and SHA512/256. Remove earlier SHA256 code which is slower than SHA512/256 (on 64-bit CPU). Use HMAC from Alan Saddi's implementation for cleaner, faster code.
2013-01-25 17:25:55 +00:00
SHA2_FLAGS = $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) @FPTR_FLAG@
Add support for 64-bit Keccak implementation. Sanitize error message from tests. Add more tests. Improve platform detection in config script.
2012-12-08 08:49:01 +00:00
KECCAK_FLAGS = $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) @FPTR_FLAG@
Initial Commit.
2012-05-28 14:49:29 +00:00
all: $(PROG)
Add ability to adjust chunk boundary based on Rabin Fingerprinting to improve compression. Remove unnecessary checks in compression loop.
2012-06-21 14:57:05 +00:00
$(LZMAOBJS): $(LZMASRCS) $(LZMAHDRS)
Bias fingerprint value with occurrence counts for a better sketch Fix latent bug when calling algo deinit in decompression code Reduce diff threshold for slightly greater delta encoding Limit similar buffer size difference for less wasted diffing Change zlib compression wrapper to use faster deflateReset mechanism Reduce optimization level for Dedupe code, it goes faster
2012-08-08 17:10:58 +00:00
$(COMPILE) $(GEN_OPT) $(CPPFLAGS) $(@:.o=.c) -o $@
Initial Commit.
2012-05-28 14:49:29 +00:00
Add ability to adjust chunk boundary based on Rabin Fingerprinting to improve compression. Remove unnecessary checks in compression loop.
2012-06-21 14:57:05 +00:00
$(CRCOBJS): $(CRCSRCS) $(CRCHDRS)
Bias fingerprint value with occurrence counts for a better sketch Fix latent bug when calling algo deinit in decompression code Reduce diff threshold for slightly greater delta encoding Limit similar buffer size difference for less wasted diffing Change zlib compression wrapper to use faster deflateReset mechanism Reduce optimization level for Dedupe code, it goes faster
2012-08-08 17:10:58 +00:00
$(COMPILE) $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Initial Commit.
2012-05-28 14:49:29 +00:00
$(PPMDOBJS): $(PPMDSRCS) $(PPMDHDRS)
Bias fingerprint value with occurrence counts for a better sketch Fix latent bug when calling algo deinit in decompression code Reduce diff threshold for slightly greater delta encoding Limit similar buffer size difference for less wasted diffing Change zlib compression wrapper to use faster deflateReset mechanism Reduce optimization level for Dedupe code, it goes faster
2012-08-08 17:10:58 +00:00
$(COMPILE) $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Initial Commit.
2012-05-28 14:49:29 +00:00
Add ability to adjust chunk boundary based on Rabin Fingerprinting to improve compression. Remove unnecessary checks in compression loop.
2012-06-21 14:57:05 +00:00
$(RABINOBJS): $(RABINSRCS) $(RABINHDRS)
Introduce strict compiler flags and fix scores of warnings/issues. Avoid different optimization flags for Dedupe sources. Fix liberal mixing of uint64_t and int64_t (should all be uint64_t). Fix corner case crash when decompressing.
2012-12-27 17:36:48 +00:00
$(COMPILE) $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Add ability to adjust chunk boundary based on Rabin Fingerprinting to improve compression. Remove unnecessary checks in compression loop.
2012-06-21 14:57:05 +00:00
Implement Delta Encoding based on modified bsdiff. Change to more accurate Sketch value computation approach.
2012-07-19 16:11:07 +00:00
$(BSDIFFOBJS): $(BSDIFFSRCS) $(BSDIFFHDRS)
Bias fingerprint value with occurrence counts for a better sketch Fix latent bug when calling algo deinit in decompression code Reduce diff threshold for slightly greater delta encoding Limit similar buffer size difference for less wasted diffing Change zlib compression wrapper to use faster deflateReset mechanism Reduce optimization level for Dedupe code, it goes faster
2012-08-08 17:10:58 +00:00
$(COMPILE) $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Implement Delta Encoding based on modified bsdiff. Change to more accurate Sketch value computation approach.
2012-07-19 16:11:07 +00:00
Add LZFX Compression support, a very fast lightweight compressor. Avoid a branch in the rabin loop.
2012-07-22 18:45:08 +00:00
$(LZFXOBJS): $(LZFXSRCS) $(LZFXHDRS)
Bias fingerprint value with occurrence counts for a better sketch Fix latent bug when calling algo deinit in decompression code Reduce diff threshold for slightly greater delta encoding Limit similar buffer size difference for less wasted diffing Change zlib compression wrapper to use faster deflateReset mechanism Reduce optimization level for Dedupe code, it goes faster
2012-08-08 17:10:58 +00:00
$(COMPILE) $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Add support for LZ4 compression including multi-pass LZ4. Add missing Read_Adjusted() declaration, was causing a crash with 2GB chunks. Fix minor cut-paste issues in comments.
2012-07-25 15:37:36 +00:00
$(LZ4OBJS): $(LZ4SRCS) $(LZ4HDRS)
Bias fingerprint value with occurrence counts for a better sketch Fix latent bug when calling algo deinit in decompression code Reduce diff threshold for slightly greater delta encoding Limit similar buffer size difference for less wasted diffing Change zlib compression wrapper to use faster deflateReset mechanism Reduce optimization level for Dedupe code, it goes faster
2012-08-08 17:10:58 +00:00
$(COMPILE) $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Add LZFX Compression support, a very fast lightweight compressor. Avoid a branch in the rabin loop.
2012-07-22 18:45:08 +00:00
Add LZP Pre-Compression support ported from libbsc. Add generic pre-processing wrappers for future support of other pre-processors. Clean up computation of Rabin block sizes. Compute Rabin scratch space accurately to avoid RAM wastage.
2012-08-23 17:28:44 +00:00
$(LZPOBJS): $(LZPSRCS) $(LZPHDRS)
$(COMPILE) $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Implement Adaptive Delta Encoding.
2012-12-04 18:39:47 +00:00
$(DELTA2OBJS): $(DELTA2SRCS) $(DELTA2HDRS)
$(COMPILE) $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Add basic framework for file type based filters during libarchive stage. Add packJPG filter for Jpeg files (not active yet). Directory format changes for clarity.
2013-11-10 17:39:42 +00:00
$(ARCHIVEOBJS): $(ARCHIVESRCS) $(ARCHIVEHDRS)
$(COMPILE) $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
$(PJPGOBJS): $(PJPGSRCS) $(PJPGHDRS)
Tweak optimization flags for libbsc. Reduce max opt level on OS X to avoid crashes due to Gcc code generation quirks.
2014-05-09 17:23:47 +00:00
$(COMPILE_cpp) $(COMMON_VEC_FLAGS) @SSE_OPT_FLAGS@ @USE_CLANG_AS@ -O2 -fsched-spec-load \
Add basic framework for file type based filters during libarchive stage. Add packJPG filter for Jpeg files (not active yet). Directory format changes for clarity.
2013-11-10 17:39:42 +00:00
$(VEC_FLAGS) -DBUILD_LIB $(COMMON_CPPFLAGS_cpp) $(@:.o=.cpp) -o $@
Pull in private copy of libarchive to add pcmpress-specific functionality. First step to add packPNM support.
2014-09-11 13:04:43 +00:00
$(PPNMOBJS): $(PPNMSRCS) $(PPNMHDRS)
$(COMPILE_cpp) $(COMMON_VEC_FLAGS) @SSE_OPT_FLAGS@ @USE_CLANG_AS@ -O2 -fsched-spec-load \
$(VEC_FLAGS) -DBUILD_LIB $(COMMON_CPPFLAGS_cpp) $(@:.o=.cpp) -o $@
Add Dispack filter with auto-detection of x86 executables in archive mode. More elaborate magic header based detection of 32-bit and 64-bit x86 binaries. Always use fast-mode LZ4 in Adaptive modes.
2013-11-24 14:15:58 +00:00
$(DISPACKOBJS): $(DISPACKSRCS) $(DISPACKHDRS)
Tweak optimization flags for libbsc. Reduce max opt level on OS X to avoid crashes due to Gcc code generation quirks.
2014-05-09 17:23:47 +00:00
$(COMPILE_cpp) $(COMMON_VEC_FLAGS) @DEBUG_STATS_CPPFLAGS@ @SSE_OPT_FLAGS@ @USE_CLANG_AS@ -O2 -fsched-spec-load \
Get rid of nagging warning.
2013-11-26 16:13:17 +00:00
-Wno-variadic-macros $(VEC_FLAGS) $(COMMON_CPPFLAGS_cpp) $(@:.o=.cpp) -o $@
Add Dispack filter with auto-detection of x86 executables in archive mode. More elaborate magic header based detection of 32-bit and 64-bit x86 binaries. Always use fast-mode LZ4 in Adaptive modes.
2013-11-24 14:15:58 +00:00
Add ASM version of Skein for x64 platforms with auto-detection Error checking for checksum flag when decompressing Update comments and READMEs
2012-09-01 09:10:15 +00:00
$(SKEIN_BLOCK_OBJ): $(SKEIN_BLOCK_SRC)
Add support for 64-bit Keccak implementation. Sanitize error message from tests. Add more tests. Improve platform detection in config script.
2012-12-08 08:49:01 +00:00
$(COMPILE) $(SKEIN_FLAGS) $(SKEIN_BLOCK_SRC) -o $@
Add ASM version of Skein for x64 platforms with auto-detection Error checking for checksum flag when decompressing Update comments and READMEs
2012-09-01 09:10:15 +00:00
Add support for Skein512 and Skein256 checksums Import Skein code from NIST CD submission Make checksum algorithms pluggable Fix handling of huge buffers (>2GB) in LZP Cleanup of some buffer sizing code Speed up CRC64 calculation in dedupe chunking
2012-08-31 17:06:06 +00:00
$(SKEINOBJS): $(SKEINSRCS) $(SKEINHDRS)
Add support for 64-bit Keccak implementation. Sanitize error message from tests. Add more tests. Improve platform detection in config script.
2012-12-08 08:49:01 +00:00
$(COMPILE) $(SKEIN_FLAGS) $(@:.o=.c) -o $@
Add support for Skein512 and Skein256 checksums Import Skein code from NIST CD submission Make checksum algorithms pluggable Fix handling of huge buffers (>2GB) in LZP Cleanup of some buffer sizing code Speed up CRC64 calculation in dedupe chunking
2012-08-31 17:06:06 +00:00
Major changes to use Intel's optimized SHA512 code for SHA512 and SHA512/256. Remove earlier SHA256 code which is slower than SHA512/256 (on 64-bit CPU). Use HMAC from Alan Saddi's implementation for cleaner, faster code.
2013-01-25 17:25:55 +00:00
$(SHA2_OBJS): $(SHA2_SRCS) $(SHA2_HDRS)
$(COMPILE) $(SHA2_FLAGS) $(@:.o=.c) -o $@
Incorporate SSE/AVX optimized Intel SHA-256 implementation. Add support for runtime cpuid detection.
2012-10-06 15:21:23 +00:00
Major changes to use Intel's optimized SHA512 code for SHA512 and SHA512/256. Remove earlier SHA256 code which is slower than SHA512/256 (on 64-bit CPU). Use HMAC from Alan Saddi's implementation for cleaner, faster code.
2013-01-25 17:25:55 +00:00
$(SHA2ASM_OBJS): $(SHA2ASM_SRCS)
Incorporate SSE/AVX optimized Intel SHA-256 implementation. Add support for runtime cpuid detection.
2012-10-06 15:21:23 +00:00
$(YASM) -o $@ $(@:.o=.asm)
Add support for 64-bit Keccak implementation. Sanitize error message from tests. Add more tests. Improve platform detection in config script.
2012-12-08 08:49:01 +00:00
$(KECCAK_OBJS): $(KECCAK_SRCS) $(KECCAK_HDRS)
$(COMPILE) $(KECCAK_FLAGS) $(@:.o=.c) -o $@
More portability tweaks.
2014-05-04 06:24:33 +00:00
$(KECCAK_OBJS_OPT64_ASM2): $(KECCAK_SRC_OPT64_ASM2)
Add support for 64-bit Keccak implementation. Sanitize error message from tests. Add more tests. Improve platform detection in config script.
2012-12-08 08:49:01 +00:00
$(COMPILE) $(KECCAK_FLAGS) $(@:.o=.s) -o $@
More portability tweaks.
2014-05-04 06:24:33 +00:00
$(KECCAK_OBJS_OPT64_ASM3): $(KECCAK_SRC_OPT64_ASM3)
More portability tweaks. Fix compiler warnings.
2014-05-04 08:02:11 +00:00
$(YASM_GAS) $(@:.o=.s) -o $@
More portability tweaks.
2014-05-04 06:24:33 +00:00
$(KECCAK_OBJS_ASM): $(KECCAK_SRCS_ASM) $(KECCAK_HDRS)
Add forked and optimized copy of LGPL version of Libbsc. Strip out Sort Transform from Libbsc copy. Reduce Libbsc memory use. Avoid redundant adler32 of data block in Libbsc.
2013-11-30 16:43:33 +00:00
$(LIBBSCWRAPOBJ): $(LIBBSCWRAP)
Add support for libbsc a high-performance block sorting compressor. Enable external algorithm threading for single chunk compressed files. Update docs.
2012-08-27 16:21:55 +00:00
$(COMPILE) $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Add Matrix Transpose of Dedupe index to compress it better. Fix handling of Dedupe index compression failure.
2012-12-12 18:30:47 +00:00
$(TRANSP_OBJS): $(TRANSP_SRCS) $(TRANSP_HDRS)
$(COMPILE) $(GEN_OPT) $(VEC_FLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Add Vector Permute AES from OpenSSL 1.0.1e. Remain compatible with older OpenSSL versions.
2013-02-24 18:22:34 +00:00
$(CRYPTO_OBJS): $(CRYPTO_SRCS) $(CRYPTO_HDRS) $(CRYPTO_ASM_OBJS)
Enable building with alternate Zlib and Bzlib. Update README and comments. Fix correct setting of output size when using Delta2 without LZP.
2012-12-16 17:47:04 +00:00
$(COMPILE) $(GEN_OPT) $(CRYPTO_CPPFLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Add Vector Permute AES from OpenSSL 1.0.1e. Remain compatible with older OpenSSL versions.
2013-02-24 18:22:34 +00:00
$(CRYPTO_ASM_OBJS): $(CRYPTO_ASM_SRCS) $(CRYPTO_ASM_HDRS)
More portability tweaks.
2014-05-04 06:24:33 +00:00
$(CRYPTO_ASM_COMPILE) -o $@ $(@:.o=.s)
Add Vector Permute AES from OpenSSL 1.0.1e. Remain compatible with older OpenSSL versions.
2013-02-24 18:22:34 +00:00
Add compatibility to decode old-format parallel hashes created with version 1.2. Bump archive version to 7 as parallel hashes are now merkle style hashes.
2013-02-24 14:35:16 +00:00
$(CRYPTO_COMPAT_OBJS): $(CRYPTO_COMPAT_SRCS) $(CRYPTO_COMPAT_HDRS)
$(COMPILE) $(GEN_OPT) $(CRYPTO_CPPFLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Enable building with alternate Zlib and Bzlib. Update README and comments. Fix correct setting of output size when using Delta2 without LZP.
2012-12-16 17:47:04 +00:00
$(ZLIB_OBJS): $(ZLIB_SRCS) $(ZLIB_HDRS)
$(COMPILE) $(GEN_OPT) $(ZLIB_CPPFLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
$(BZLIB_OBJS): $(BZLIB_SRCS) $(BZLIB_HDRS)
$(COMPILE) $(GEN_OPT) $(BZLIB_CPPFLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Changes for generalized runtime SSE/AVX/XOP detection. Multi instruction set XXhash build with runtime selection. Extend CPUID code to detect more instruction sets. Add options for BLAKE2 hash. Move GCC builtins into utils header. Bump file format version number due to extended digest flags. Add descriptions to digest list.
2013-01-24 18:40:12 +00:00
$(XXHASH_OBJS): $(XXHASH_SSE4_SRCS) $(XXHASH_SSE2_SRCS) $(XXHASH_HDRS) $(XXHASH_SRCS)
$(COMPILE) $(BASE_OPT) $(SSE4_OPT_FLAG) $(CPPFLAGS) $(XXHASH_SSE4_SRCS) -o $(XXHASH_SSE4_SRCS:.c=.o)
$(COMPILE) $(BASE_OPT) $(SSE2_OPT_FLAG) $(CPPFLAGS) $(XXHASH_SSE2_SRCS) -o $(XXHASH_SSE2_SRCS:.c=.o)
Add optimized BLAKE2 implementations with runtime detection of CPU capability (SSE/AVX). Minor cleanups.
2013-01-26 10:09:10 +00:00
$(BLAKE2_OBJS): $(BLAKE2_SRCS) $(BLAKE2_BASE_SRCS) $(BLAKE2_HDRS)
$(COMPILE) $(BASE_OPT) $(SSE2_OPT_FLAG) $(CPPFLAGS) $(BLAKE2b_SSE2) -o $(BLAKE2b_SSE2:.c=.o)
$(COMPILE) $(BASE_OPT) $(SSE3_OPT_FLAG) $(CPPFLAGS) $(BLAKE2b_SSE3) -o $(BLAKE2b_SSE3:.c=.o)
$(COMPILE) $(BASE_OPT) $(SSE4_OPT_FLAG) $(CPPFLAGS) $(BLAKE2b_SSE4) -o $(BLAKE2b_SSE4:.c=.o)
$(COMPILE) $(BASE_OPT) $(AVX_OPT_FLAG) $(CPPFLAGS) $(BLAKE2b_AVX) -o $(BLAKE2b_AVX:.c=.o)
$(COMPILE) $(BASE_OPT) $(SSE2_OPT_FLAG) $(CPPFLAGS) $(BLAKE2bp_SSE2) -o $(BLAKE2bp_SSE2:.c=.o)
$(COMPILE) $(BASE_OPT) $(SSE3_OPT_FLAG) $(CPPFLAGS) $(BLAKE2bp_SSE3) -o $(BLAKE2bp_SSE3:.c=.o)
$(COMPILE) $(BASE_OPT) $(SSE4_OPT_FLAG) $(CPPFLAGS) $(BLAKE2bp_SSE4) -o $(BLAKE2bp_SSE4:.c=.o)
$(COMPILE) $(BASE_OPT) $(AVX_OPT_FLAG) $(CPPFLAGS) $(BLAKE2bp_AVX) -o $(BLAKE2bp_AVX:.c=.o)
Add ability to adjust chunk boundary based on Rabin Fingerprinting to improve compression. Remove unnecessary checks in compression loop.
2012-06-21 14:57:05 +00:00
$(MAINOBJS): $(MAINSRCS) $(MAINHDRS)
Bias fingerprint value with occurrence counts for a better sketch Fix latent bug when calling algo deinit in decompression code Reduce diff threshold for slightly greater delta encoding Limit similar buffer size difference for less wasted diffing Change zlib compression wrapper to use faster deflateReset mechanism Reduce optimization level for Dedupe code, it goes faster
2012-08-08 17:10:58 +00:00
$(COMPILE) $(GEN_OPT) $(LOOP_OPTFLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Initial Commit.
2012-05-28 14:49:29 +00:00
Make Pcompress functionality into a library - initial changes.
2013-06-02 15:24:33 +00:00
$(PROGOBJS): $(PROGSRCS) $(PROGHDRS)
$(COMPILE) $(GEN_OPT) $(LOOP_OPTFLAGS) $(CPPFLAGS) $(@:.o=.c) -o $@
Pull in private copy of libarchive to add pcmpress-specific functionality. First step to add packPNM support.
2014-09-11 13:04:43 +00:00
Libarchive:
(cd @LIBARCHIVE_DIR@; make)
Add forked and optimized copy of LGPL version of Libbsc. Strip out Sort Transform from Libbsc copy. Reduce Libbsc memory use. Avoid redundant adler32 of data block in Libbsc.
2013-11-30 16:43:33 +00:00
$(LIBBSCLIB):
Configurable optimization level for libbsc.
2014-05-09 17:28:51 +00:00
(cd $(LIBBSCDIR); make CC=$(GPP) OPTFLAGS="-O3 @SSE_OPT_FLAGS@ @USE_CLANG_AS@")
Add forked and optimized copy of LGPL version of Libbsc. Strip out Sort Transform from Libbsc copy. Reduce Libbsc memory use. Avoid redundant adler32 of data block in Libbsc.
2013-11-30 16:43:33 +00:00
Pull in private copy of libarchive to add pcmpress-specific functionality. First step to add packPNM support.
2014-09-11 13:04:43 +00:00
$(LIB): Libarchive $(OBJS) $(LIBBSCLIB)
More portability tweaks. Fix compiler warnings.
2014-05-04 08:02:11 +00:00
$(LINK.LIB) -Wl,-soname$(LIB).$(LIBVER) -o $(LIB).$(LIBVER) $(OBJS) $(LDLIBS)
Make Pcompress functionality into a library - initial changes.
2013-06-02 15:24:33 +00:00
ln -sf $(LIB).$(LIBVER) $(LIB)
Add forked and optimized copy of LGPL version of Libbsc. Strip out Sort Transform from Libbsc copy. Reduce Libbsc memory use. Avoid redundant adler32 of data block in Libbsc.
2013-11-30 16:43:33 +00:00
./buildtmp/$(PROG):
Add a simple log facility. Refactor all printfs to use log facility.
2013-10-02 15:15:33 +00:00
mkdir -p buildtmp
Add forked and optimized copy of LGPL version of Libbsc. Strip out Sort Transform from Libbsc copy. Reduce Libbsc memory use. Avoid redundant adler32 of data block in Libbsc.
2013-11-30 16:43:33 +00:00
$(LINK.PROG) -o $@ $(PROGOBJS) $(LDLIBS) -L. -l$(LINKLIB)
Pull in private copy of libarchive to add pcmpress-specific functionality. First step to add packPNM support.
2014-09-11 13:04:43 +00:00
$(PROG): $(LIB) $(PROGOBJS) ./buildtmp/$(PROG)
Use wrapper script to set paths when launching pcompress from build directory. Use smaller max block size when doing global dedupe. Fix init of executable name.
2013-08-07 16:33:52 +00:00
cat utils/pcompress.sh | sed "s#<PC_PATH>#`pwd`#" > pcompress
chmod +x pcompress
Initial Commit.
2012-05-28 14:49:29 +00:00
Add a functionality test suite.
2012-11-08 16:52:37 +00:00
test: all
Ability to run individual test suites from makefile.
2012-12-17 15:29:27 +00:00
(cd test; ulimit -c unlimited; sh ./run_test.sh $(TESTSUITE) ) 2>&1 | tee test.log
Add a functionality test suite.
2012-11-08 16:52:37 +00:00
Initial Commit.
2012-05-28 14:49:29 +00:00
clean:
Avoid cleaning buildtmp for make clean. Causes subsequent make to fail.
2014-05-04 14:25:01 +00:00
$(RM) buildtmp/$(PROG) $(OBJS) $(PROGOBJS) $(BAKFILES) $(LIB) $(LIB).$(LIBVER)
Add a functionality test suite.
2012-11-08 16:52:37 +00:00
$(RM) test.log
$(RM_RF) test/datafiles
Pull in private copy of libarchive to add pcmpress-specific functionality. First step to add packPNM support.
2014-09-11 13:04:43 +00:00
(cd @LIBARCHIVE_DIR@; make clean)
Initial Commit.
2012-05-28 14:49:29 +00:00
Add config script to generate Makefile based on flags. Add install target and installation readme file. A few comment changes.
2012-08-26 08:39:24 +00:00
distclean: clean
$(RM) Makefile
Add forked and optimized copy of LGPL version of Libbsc. Strip out Sort Transform from Libbsc copy. Reduce Libbsc memory use. Avoid redundant adler32 of data block in Libbsc.
2013-11-30 16:43:33 +00:00
(cd $(LIBBSCDIR); make clean)
Miscellaneous refactoring. Add some headers for OSX.
2014-05-24 18:22:30 +00:00
$(RM_RF) buildtmp
Pull in private copy of libarchive to add pcmpress-specific functionality. First step to add packPNM support.
2014-09-11 13:04:43 +00:00
(cd @LIBARCHIVE_DIR@; make distclean; rm -rf Makefile.orig tar test test_utils cpio libarchive/test)
Add config script to generate Makefile based on flags. Add install target and installation readme file. A few comment changes.
2012-08-26 08:39:24 +00:00
install: $(PROG)
Enable building with alternate Zlib and Bzlib. Update README and comments. Fix correct setting of output size when using Delta2 without LZP.
2012-12-16 17:47:04 +00:00
@mkdir -p $(DESTDIR)$(PREFIX)/bin
@chmod 0755 $(DESTDIR)$(PREFIX)/bin
Use wrapper script to set paths when launching pcompress from build directory. Use smaller max block size when doing global dedupe. Fix init of executable name.
2013-08-07 16:33:52 +00:00
@cp buildtmp/$(PROG) $(DESTDIR)$(PREFIX)/bin
Enable building with alternate Zlib and Bzlib. Update README and comments. Fix correct setting of output size when using Delta2 without LZP.
2012-12-16 17:47:04 +00:00
@chmod 0555 $(DESTDIR)$(PREFIX)/bin/$(PROG)
Make Pcompress functionality into a library - initial changes.
2013-06-02 15:24:33 +00:00
@mkdir -p $(DESTDIR)$(PREFIX)/lib
@chmod 0755 $(DESTDIR)$(PREFIX)/lib
@cp $(LIB).$(LIBVER) $(DESTDIR)$(PREFIX)/lib
@chmod 0555 $(DESTDIR)$(PREFIX)/lib/$(LIB).$(LIBVER)
@ln -sf $(LIB).$(LIBVER) $(DESTDIR)$(PREFIX)/lib/$(LIB)
Enable building with alternate Zlib and Bzlib. Update README and comments. Fix correct setting of output size when using Delta2 without LZP.
2012-12-16 17:47:04 +00:00
@mkdir -p $(DESTDIR)$(PREFIX)/share/doc/$(PROG)
Make Pcompress functionality into a library - initial changes.
2013-06-02 15:24:33 +00:00
@chmod 0755 $(DESTDIR)$(PREFIX)/share $(DESTDIR)$(PREFIX)/share/doc $(DESTDIR)$(PREFIX)/share/doc/$(PROG)
Enable building with alternate Zlib and Bzlib. Update README and comments. Fix correct setting of output size when using Delta2 without LZP.
2012-12-16 17:47:04 +00:00
@cp README.md $(DESTDIR)$(PREFIX)/share/doc/$(PROG)/README
@chmod 0444 $(DESTDIR)$(PREFIX)/share/doc/$(PROG)/README
Add config script to generate Makefile based on flags. Add install target and installation readme file. A few comment changes.
2012-08-26 08:39:24 +00:00
Reference in a new issue Copy permalink