various open source compression libraries
I've needed a tool to benchmark different open source compression libraries and wrote
a simple tool to measure packtime, depacktime and the compressed length. The source code
is released here .
feel free to test your own files, I've
found that even files with a comparable structure (in my case the sponza 3d scene) can result
in very different values for depacktime etc.
you can find an example here, the same measurement with 2 different reports generated:
pack benchmark results ordered by depacktime (original file length 3386kB) 3069 4291 4549 4714 4918 4950 5211 5238 5313 5450 5563 5741 6149 6474 6786 6855 6902 7293 7570 7929 7970 8074 8139 8185 8197 8248 8889 9127 9129 10019 10105 10165 10882 10921 10926 11001 11181 11730 12010 12542 12638 12684 13942 14389 14943 15255 15893 15924 16044 18901 19064 21171 21309 21544 22143 24406 895 1538 853 1181 1241 923 1001 938 937 876 977 979 1114 1157 1128 1373 1164 1357 1351 1366 1371 1358 1491 1349 1411 1029 1322 1491 1146 1341 1329 1329 741 730 1548 552 1418 1023 1206 1327 726 742 1405 1417 906 985 1430 1439 892 1060 1046 1271 1277 1277 913 1072 depacktime packedlength in kB lzmat lz4 doboz pithy-9 pithy-5 lzo1b_999 quicklz_3 lzo1x_999 lzo1z_999 lzo1y_999 lzo1f_999 lzo1c_999 lzo1b_99 lzo1b_9 lzo1c_99 snappy lzo1c_9 lzo1b_1 lzo1c_1 lzo1f_1 lzo1x_1 lzo1y_1 lzf lzrw2 lzrw1a lzo2a_999 fastlz2 lzfx lzrw3a lzrw3 quicklz151 quicklz_1 miniz-128 miniz-4096 lzjb2010 lzham lzrw1 lz4hc quicklz_2 fastlz1 zlib9 zlib6 tornado1 tornado2 nrv2d-6 zlib1 tornado3 tornado4 nrv2e-6 nrv2d-1 nrv2e-1 tornado5 tornado6 tornado7 nrv2b-6 nrv2b-1 0 2,500 5,000 7,500 10,000 12,500 15,000 17,500 20,000 22,500 25,000 27,500 results
pack benchmark results ordered by packed length (original file length 3386kB) 11001 12638 10921 10882 12684 4549 5450 16044 3069 14943 22143 4950 5313 5238 5563 5741 15255 5211 11730 8248 19064 18901 24406 6149 6786 9129 6474 6902 4714 12010 4918 21171 21309 21544 8889 12542 10165 10105 10019 8185 7570 7293 8074 7929 7970 6855 13942 8197 14389 11181 15893 15924 8139 9127 4291 10926 552 726 730 741 742 853 876 892 895 906 913 923 937 938 977 979 985 1001 1023 1029 1046 1060 1072 1114 1128 1146 1157 1164 1181 1206 1241 1271 1277 1277 1322 1327 1329 1329 1341 1349 1351 1357 1358 1366 1371 1373 1405 1411 1417 1418 1430 1439 1491 1491 1538 1548 depacktime packedlength in kB lzham zlib9 miniz-4096 miniz-128 zlib6 doboz lzo1y_999 nrv2e-6 lzmat nrv2d-6 nrv2b-6 lzo1b_999 lzo1z_999 lzo1x_999 lzo1f_999 lzo1c_999 zlib1 quicklz_3 lz4hc lzo2a_999 nrv2e-1 nrv2d-1 nrv2b-1 lzo1b_99 lzo1c_99 lzrw3a lzo1b_9 lzo1c_9 pithy-9 quicklz_2 pithy-5 tornado5 tornado6 tornado7 fastlz2 fastlz1 quicklz_1 quicklz151 lzrw3 lzrw2 lzo1c_1 lzo1b_1 lzo1y_1 lzo1f_1 lzo1x_1 snappy tornado1 lzrw1a tornado2 lzrw1 tornado3 tornado4 lzf lzfx lz4 lzjb2010 0 2,500 5,000 7,500 10,000 12,500 15,000 17,500 20,000 22,500 25,000 27,500 results