TurboBench

TurboBench:Compressor Benchmark

• High performance precision, zero overhead. One might call it the compression lie detector
• The only benchmark program including LzTurbo
• 100% in-memory benchmark, no I/O overhead
• Include (>70) allmost all popular, latest or fastest compressors in one compiled package
• Benchmarking Entropy Coders, Lz77, Rolz, BWT and Context mixing compressors
• Multiple input files with recursive directories
• Concatenate multiple small files into one multiblock file
• Avoid cache szenario and cpu throttling found in other benchmarks
• Automatic sort, update and merge of result files
• Text, html, csv, markdown output
• :sparkles: Transfer speed sheet for different connections or devices: GPRS,2G,3G,4G,DSL,Network,HDD,SSD,RAM
• :+1: Html plot: Speedup + Speed/Ratio
• All in one executable, no hassless installing of additional packages, graphic libraries, python,...
• :+1: build in peak memory usage reporting for compression and decompression in html output

Release:

• Build or Download turbobench from releases

• List all plugins: "./turbobench -l2"<br />
• List all compiled codecs: "./turbobench -l1"<br />
• type "./turbobench -h" for help

Benchmark:

• see also: Compression Benchmark

CPU: Sandy bridge i7-2600k at 4.4GHz, gcc 6.3, single thread.

• Realistic and practical benchmark with large files

• No PURE cache benchmark

• All compressors with latest versions (2017-05-10)

• File app3.tar binary Portable Apps Suite

(bold = pareto) MB=1.000.000

|C Size|ratio%|C MB/s|D MB/s|Name| |--------:|-----:|--------:|--------:|----------------| |32823983| 32.8|3.40|67.92|lzma 9| |32872154| 32.8|0.31|315.27|brotli 11d27| |32925079| 32.9|1.70|70.67|lzturbo 49| |33936389| 33.9|2.57|1701.35|lzturbo 39| |34105370| 34.1|3.32|952.59|zstd 22| |36751363| 36.7|48.30|1701.59|lzturbo 32| |36920708| 36.7|2.98|2355.32|lzturbo 29| |46546059| 46.5|163.77|1489.57|lzturbo 31| |46805879| 46.8|44.66|940.64|zstd 9| |48152545| 48.1|52.94|349.62|brotli 4| |49497505| 49.4| 2.48|2299.20|lizard 49 |49773790| 49.7|38.08|1952.73|lzturbo 22| |49860700| 49.8|16.94|295.99|zlib 9| |49962678| 49.9|35.70|294.24|zlib 6| |50278958| 50.2|282.43|1372.91|lzturbo 30| |52509931| 52.5|290.96|347.16|brotli 1| |52549655| 52.5|239.35|2153.41|lzturbo 21| |52928477| 52.9|69.17|276.75|zlib 1| |52983490| 52.9|393.67|984.00|zstd 1| |54251482| 54.2|2.60|4367.15|lzturbo 19| |54410769| 54.4|46.37|3305.22|lz4 9| |55923645| 55.9|188.40|4200.23|lzturbo 12| |57606731| 57.6|386.90|3948.64|lzturbo 11| |59085723| 59.0|698.39|2196.24|lzturbo 20| |61455711| 61.4|800.71|4003.54|lzturbo 10| |61938605| 61.9|730.46|3330.40|lz4 1| |100098564|100.0|8647.84|8408.10|memcpy|

---

Hardware: ODROID C2 - ARM 64 bits - 2Ghz CPU, OS: Ubuntu 16.04, gcc 5.3<br> Compressors with versions 16.08.2016 <br> pd3d.tar - 3D Test Set (RAD Game Tools)

|C Size|ratio|C MB/s|D MB/s|Name| |--------:|-----:|--------:|--------:|----------------| |8052040| 25.2|0.53|23.23|lzma 9| |9092280| 28.4|0.08|52.61|brotli 11| |9159574| 28.7|0.52|119.76|lzturbo 39| |9691094| 30.3|0.68|94.02|zstd 22| |9826984| 30.7|3.24|136.91|lzturbo 32| |10264073| 32.1|26.15|142.28|lzturbo 30| |10427322| 32.6|4.90|108.76|zstd 9| |10938385| 34.2|9.46|110.38|lzfse| |10966870| 34.3|8.92|101.96|zstd 5| |11059511| 34.6|1.74|98.16|zlib 9| |11121480| 34.8|7.63|97.47|zlib 6| |12649309| 39.6|0.61|366.17|lzturbo 29| |13302907| 41.6|19.07|435.28|lzturbo 21| |14237494| 44.5|0.66|500.67|lzturbo 19| |14283317| 44.7|10.04|329.14|lz4 9| |14723054| 46.1|103.21|483.81|lzturbo 20| |14814049| 46.4|8.14|484.09|lzturbo 12| |16069593| 50.3|121.12|365.08|lz4 1| |16166867| 50.6|111.43|475.66|lzturbo 10| |31952896|100.0|1676.10|1704.00|memcpy|

- Groups FASTEST,FAST,EFFICIENT,MAX,OPTIMAL,BWT:

• test all fast compressors in the lz4, lzturbo, zlib class<br /> (additional groups can be defined in the "turbobench.ini" file)

  ./turbobench -eFAST file
  

• Some codecs can accept additional parameters (see option -l1 or file plugins.cc) (colon ':' as separator)

  ./turbobench -elzma,9mt2:d29:a1:fb273:mf=bt4:mc999:lc8:lp0:pb2 file
  

- Codecs:

• individual codec test (output to screen & file.tbb)<br />

  ./turbobench -elzturbo,19,29,39/brotli,6/zlib,6 file
  

• retest or test other compressors and merge the results to file.tbb<br />

  ./turbobench -eFAST/bzip2 file
  

- Print + Plot

• Print result file + "transfer+decompression speedup" plot to file.html for browsing

  ./turbobench -p2 -S2 file.tbb

Compile:

	git clone --depth=1 --recursive https://github.com/powturbo/TurboBench.git
    cd TurboBench
	make

Turbobench mini: compile (only popular codecs)

	make NCODEC2=1

Turbobench incl. Entropy Coder codecs

    make EC=1

Environment:

OS/Compiler (32 + 64 bits):

• Windows: MinGW-w64 makefile
• Linux amd/intel: GNU GCC (>=4.6)
• Linux amd/intel: Clang (>=3.2)
• Linux arm: aarch64
• MaxOS: XCode (>=9)
• PowerPC ppc64le
• IBM Z series s390x

Plugins:

Compressor Lz77,Rolz,Bwt,zpaq:

• LzTurbo
• Blosc
• BriefLz
• Brotli
• Bzip2
• Chameleon
• CSC
• Density
• Doboz
• FastLz
• Fast-lzma
• glza
• heatshrink
• Intel(R) Intelligent Storage Acceleration Library
• bsc
• Libdeflate
• LibLZF
• LibLz
• LibSLZ
• Lz4
• Lz4ultra
• lzjody :new:2023.06
• lizard
• Lzfse
• Lzham v1.1
• Lzlib
• Lzmat
• Lzma
• Lzo
• Lzoma
• LZSSE
• LZSA
• Miniz
• ms-compress
• Nakamichi Washigan
• Oodle (windows + linux) :new:2023.05
• Quantile Compression
• Pithy
• Quicklz
• sap
• shoco
• Shrinker
• Smallz4
• Snappy
• Snappy-c
• Tornado
• Unishox
• wfLZ
• yalz77
• yappy v2011
• zlib
• zlib-ng
• zlib cloudflare
• xpack
• zopfli
• zstd
• zpaq

Entropy coder:

bitwise range coder

• TurboRC-Range Coder
• Bitwise RC v2010
• Bitwise vector RC v2012
• AOMedia AV1 entropy coder
• Daala entropy coder
• FastAri v15-10

bytewise range coder

• TurboAC
• subotin range coder v2000
• Fast AC v2006
• FQZ/PPMD Range Coder v15-03
• PPMD Range Coder v15-03
• sserangecoding :new:2023.05

ABS: Asymmetric binary systems

• Fpaqc:Asymmetric Binary Coder v07-12

ANS: Asymmetric Numeral Systems

• [