Files in the top-level directory in any check-in
- .project
- .settings
- doc
- src
- README
- Results.ods
- TODO
Yeah, everybody puts nonsense they consider important in a place that's hard to miss, though they know that readers are skilled in skipping them. I'll do the same. ****** About: ****** This is an application meant to easen benchmarking of in-memory data transformations. It started as a tool to simulate the way filesystems use compression, but its flexibility improved over time so much that testing other things works OK. Aside from compression algorithms it features ciphers and hashes and could be repurposed for nearly anything. ********* Features: ********* * multithreading * splitting data into blocks * testing in any level of cache or in RAM * overhead as low as 7 ticks/block on AMD64 and 11 on ARM ***************** How does it work: ***************** 1. It warms the CPU up with several iterations (-w) of memory shuffling. 2. If job_size (-j) is not defined, it tries to come up with a good one. 3. It splits the data into blocks (see -b switch). 4. It creates encoding threads (-t). 5. Each thread gets a number of blocks with a total size of at least job_size (-j). Note: Blocks are not split to smaller entities. When the entire file comes in just 1 block (which happens often with the defaults), it will be assigned to a single thread as a whole. The others won't get any work. 6. Encoding of each block is repeated overhead_iterations number of times (-o). This is meant to reduce the overhead introduced by the benchmark itself. It's needed only for testing data that fits in L1 cache with the fastest transforms. 7. Each thread encodes asigned blocks and asks for another job. Repeats until everything's compressed. If encoder is a compressor, block has to be reduced by it by at least sector_size of bytes (-m), otherwise it's left uncompressed. 8. Each thread decodes __encoded__ blocks. Please note that these may be different from different codecs. If one failed to encode some block (i.e. compress by at least sector_size), it doesn't get to decode it. Decoding speed takes into account only blocks that were encoded successfully. 9. Points 6 and 7 are repeated for at least small_iter_time ms. (-s), the runtimes are summed up. This is to compensate for clock inaccuracies. 10. Point 8 is repeated iters (-i) number of times, there's a minimum of runtimes taken. This is meant to reduce testing variability. ***************** In-cache testing: ***************** Testing in-cache is being performed by running encoder/decoder repeatadly on a piece of data that fits completely in your cache. To do so, you need to specify a *small enough* block (with -b switch) and a fair number of overhead iterations (-o). What is small enough? For ciphers / hashes, take slightly less than the size of your cache. For compressors - enough to contain both compressed and uncompressed data. **************** Included codecs: **************** Some codecs are in the default installation, some you have to enable with a compile-time option. See CMakeFiles.txt if you want them. Checksums: name | author | version | default? | source -------------------------------------------------------------------------------------------------------------------- Blake224 | multiple | SHA3 Final, 64bit opt | yes | Blake256 | multiple | SHA3 Final, 64bit opt | yes | Blake384 | multiple | SHA3 Final, 64bit opt | yes | Blake512 | multiple | SHA3 Final, 64bit opt | yes | Blake2b | multiple | 20130131 | yes | https://blake2.net Blake2bp | multiple | 20130131 | yes | https://blake2.net Blake2s | multiple | 20130131 | yes | https://blake2.net Blake2sp | multiple | 20130131 | yes | https://blake2.net BlueMidnightWish224 | Danilo Gligoroski | SHA3 rnd 2, 64bit opt | no | BlueMidnightWish256 | Danilo Gligoroski | SHA3 rnd 2, 64bit opt | no | BlueMidnightWish384 | Danilo Gligoroski | SHA3 rnd 1, 64bit opt | no | BlueMidnightWish512 | Danilo Gligoroski | SHA3 rnd 1, 64bit opt | no | CityHash32 | Geoff Pike, Jyrki Alakuijala | 1.1.0 | no | https://code.google.com/p/cityhash CityHash64 | Geoff Pike, Jyrki Alakuijala | 1.1.0 | no | https://code.google.com/p/cityhash CityHash128 | Geoff Pike, Jyrki Alakuijala | 1.1.0 | no | https://code.google.com/p/cityhash CrapWow | Andrew@Team5150.com | 2012-06-07 | no | www.team5150.com/~andrew/noncryptohashzoo crypto++ - adler32 | Wei Dai | 5.6.1 | no | www.cryptopp.com crypto++ - crc32 | Wei Dai | 5.6.1 | no | www.cryptopp.com crypto++ - md5 | Colin Plumb, Wei Dai | 5.6.1 | no | www.cryptopp.com crypto++ - sha224 | Steve Reid, Wei Dai | 5.6.1 | no | www.cryptopp.com crypto++ - sha256 | Steve Reid, Wei Dai | 5.6.1 | no | www.cryptopp.com crypto++ - sha384 | Steve Reid, Wei Dai | 5.6.1 | no | www.cryptopp.com crypto++ - sha512 | Steve Reid, Wei Dai | 5.6.1 | no | www.cryptopp.com CubeHash224 | Daniel J. Bernstein | SHA3 rnd 2, 64bit opt | no | CubeHash256 | Daniel J. Bernstein | SHA3 rnd 2, 64bit opt | no | CubeHash384 | Daniel J. Bernstein | SHA3 rnd 2, 64bit opt | no | CubeHash512 | Daniel J. Bernstein | SHA3 rnd 2, 64bit opt | no | Edon-R224 | multiple | v20 | no | www.item.ntnu.no/people/personalpages/fac/danilog/edon-r Edon-R256 | multiple | v20 | no | www.item.ntnu.no/people/personalpages/fac/danilog/edon-r Edon-R384 | multiple | v20 | no | www.item.ntnu.no/people/personalpages/fac/danilog/edon-r Edon-R512 | multiple | v20 | no | www.item.ntnu.no/people/personalpages/fac/danilog/edon-r FarmHash32 | ? | SVN r4 | yes | https://code.google.com/p/farmhash FarmHash64 | ? | SVN r4 | yes | https://code.google.com/p/farmhash FarmHash128 | ? | SVN r4 | yes | https://code.google.com/p/farmhash fletcher2 | ?? (used in ZFS) | 2010 | no | fletcher4 | ?? (used in ZFS) | 2010 | no | FNV1a-Jesteress | Georgi Marinov | 2012-06-09 | yes | www.sanmayce.com/Fastest_Hash/index.html FNV1a-Mantis | Georgi Marinov | 2012-06-09 | yes | www.sanmayce.com/Fastest_Hash/index.html FNV1a-Meiyan | Georgi Marinov | 2012-06-09 | yes | www.sanmayce.com/Fastest_Hash/index.html FNV1a-Penumbra | Georgi Marinov | 2013-06-16 | yes | www.sanmayce.com/Fastest_Hash/index.html FNV1a-Tesla | Georgi Marinov | v2 | yes | www.sanmayce.com/Fastest_Hash/index.html FNV1a-Tesla3 | Georgi Marinov | 2013-03-13 | yes | www.sanmayce.com/Fastest_Hash/index.html FNV1a-Yorikke | Georgi Marinov | 2013-05-12 | yes | www.sanmayce.com/Fastest_Hash/index.html FNV1a-YoshitsuTRIAD | Georgi Marinov | 2013-05-12 | yes | www.sanmayce.com/Fastest_Hash/index.html FNV1a-YoshimitsuTRIADiiXMM | Georgi Marinov | 2013-05-12 | yes | www.sanmayce.com/Fastest_Hash/index.html FNV1a-Yoshimura | Georgi Marinov | 2013-03-13 | yes | www.sanmayce.com/Fastest_Hash/index.html Grøstl224 | Soeren S. Thomsen, Krystian Matusiewicz | SHA3 Final, 64bit opt | yes | Grøstl256 | Soeren S. Thomsen, Krystian Matusiewicz | SHA3 Final, 64bit opt | yes | Grøstl384 | Soeren S. Thomsen, Krystian Matusiewicz | SHA3 Final, 64bit opt | yes | Grøstl512 | Soeren S. Thomsen, Krystian Matusiewicz | SHA3 Final, 64bit opt | yes | JH224 | Hongjun Wu | SHA3 Final, 64bit opt | yes | JH256 | Hongjun Wu | SHA3 Final, 64bit opt | yes | JH384 | Hongjun Wu | SHA3 Final, 64bit opt | yes | JH512 | Hongjun Wu | SHA3 Final, 64bit opt | yes | Keccak224 | multiple | SHA3 Final, 64bit opt | yes | Keccak256 | multiple | SHA3 Final, 64bit opt | yes | Keccak384 | multiple | SHA3 Final, 64bit opt | yes | Keccak512 | multiple | SHA3 Final, 64bit opt | yes | murmur3_x86_32 | Austin Appleby | 2012-02-29 | yes | murmur3_x86_128 | Austin Appleby | 2012-02-29 | yes | murmur3_x64_128 | Austin Appleby | 2012-02-29 | yes | SipHash | Jean-Philippe Aumasson, Daniel J. Bernstein | reference | yes | https://131002.net/siphash Skein224 | Doug Whiting | SHA3 Final, 64bit opt | yes | Skein256 | Doug Whiting | SHA3 Final, 64bit opt | yes | Skein384 | Doug Whiting | SHA3 Final, 64bit opt | yes | Skein512 | Doug Whiting | SHA3 Final, 64bit opt | yes | Skein1024 | Doug Whiting | SHA3 Final, 64bit opt | yes | SpookyHash | Bob Jenkins | V2 2012-08-05 | yes | http://burtleburtle.net/bob/hash/spooky.html SWIFFTX224 | multiple | SHA3 rnd 1, 64bit opt | no | SWIFFTX256 | multiple | SHA3 rnd 1, 64bit opt | no | SWIFFTX384 | multiple | SHA3 rnd 1, 64bit opt | no | SWIFFTX512 | multiple | SHA3 rnd 1, 64bit opt | no | uhash | Ted Krovetz | 2007-04-17 | yes | www.fastcrypto.com vhash | Ted Krovetz, Wei Dai | 2007-04-17 | yes | www.fastcrypto.com umac | Ted Krovetz | 2007-04-17 | yes | www.fastcrypto.com vmac | Ted Krovetz, Wei Dai | 2007-04-17 | yes | www.fastcrypto.com xxhash | Yann Collet | r39 | yes | https://code.google.com/p/xxhash xxhash64 | Yann Collet | r39 | yes | https://code.google.com/p/xxhash Ciphers: name | author | version | default? | ------------------------------------------------------------------------------------------------------- AES128 | Daniel J. Bernstein | little-4 | yes | AES256 | Hongjun Wu | v1 | yes | ChaCha | Daniel J. Bernstein | 20080118 | yes | HC-128 | ?? | 2007-01b | yes | HC-256 | ?? | 2007-01 | yes | LEX | Alex Biryukov | v2 | yes | Rabbit | ?? | opt2 | yes | RC4 | Christophe De Cannière | 2005-08-21 | yes | Salsa20/8 | Daniel J. Bernstein | merged | yes | Salsa20/12 | Daniel J. Bernstein | merged | yes | Salsa20 | Daniel J. Bernstein | merged | yes | Snow 2.0 | Patrik Ekdahl and Thomas Johansson | fast | yes | Sosemanuk | Thomas Pornin | 2005-04-26 | yes | Trivium | Christophe De Cannière | 2006-02-23 | yes | Compressors: name | author | version | default? | source -------------------------------------------------------------------------------------------------------------------------------- 7z - deflate | Igor Pavlov | 9.20 | yes | http://7-zip.org 7z - deflate64 | Igor Pavlov | 9.20 | yes | http://7-zip.org ar | Haruhiko Okumura, Kerwin F. Medina, SanguineRose | 2013-06-03 | no | https://github.com/Sanguinarious/lzh-improved Basic Compression Library - huffman | Marcus Geelnard | 1.2.0 | no | http://bcl.comli.eu Basic Compression Library - lz | Marcus Geelnard | 1.2.0 | no | http://bcl.comli.eu Basic Compression Library - lzfast | Marcus Geelnard | 1.2.0 | no | http://bcl.comli.eu Basic Compression Library - rle | Marcus Geelnard | 1.2.0 | no | http://bcl.comli.eu blosc | Francesc Alted | 1.5.2 | no | http://blosc.pytables.org/trac BriefLZ | Joergen Ibsen | 1.0.5 | no | http://ibsensoftware.com/download.html Brotli | Jyrki Alakuijala, Zoltan Szabadka | 2015-02-01 | no | https://github.com/google/brotli bzip2 | Julian Seward | 1.0.6 | yes | http://bzip.org crush | Ilia Muraviev | 0.0.1 | yes | http://encode.ru/threads/1289-CRUSH-0-01-is-here! crypto++ - deflate | Wei Dai | 5.6.1 | yes | www.cryptopp.com Density | Guillaume Voirin | 0.12.0 beta | yes | https://github.com/centaurean/density Doboz | Attila T. Áfra | 2011-03-19 | no | https://bitbucket.org/attila_afra/doboz/downloads FastLZ | Ariya Hidayat | 0.1.0 | no | http://fastlz.org FSE | Yann Collet | 2014-04-07 | no | https://github.com/Cyan4973/FiniteStateEntropy gipfeli | Rasto Lenhardt, Jyrki Alakuijala | 2014-06-27 | no | https://github.com/google/gipfeli Halibut - deflate | Simon Tatham | SVN r9550 | no | http://www.chiark.greenend.org.uk/~sgtatham/halibut lodepng - deflate | Lode Vandevenne | 20120729 | no | http://lodev.org/lodepng lrrle | m^2 | 0 | yes | LZ4 | Yann Collet | r127 | yes | https://code.google.com/p/lz4 LZ4hc | Yann Collet | r127 | yes | https://code.google.com/p/lz4 LZF | Marc Alexander Lehmann | 3.6 | yes | http://oldhome.schmorp.de/marc/liblzf.html LZFX | Andrew Collette | r16 | no | https://code.google.com/p/lzfx LZG | Marcus Geelnard | 1.0.6 | no | http://liblzg.bitsnbites.eu LZHAM | Richard Geldreich, Jr. | 2015-01-31 | no | https://github.com/richgel999/lzham_codec LZJB | Jeff Bonwick | FreeBSD r263244 | no | mmini - lzl | Adam Ierymenko | 2010 | no | https://code.google.com/p/mmini LZMAT | Vitaly Evseenko | 1.1 | yes | www.matcode.com/lzmat.htm LZO | Markus Franz Xaver Johannes Oberhumer | 2.08 | yes | www.oberhumer.com/opensource/lzo LZP_ds | Dmitry Shkarin | v0 | no | http://www.ctxmodel.net/files/LZP-DS_v0.rar LZSS | Ilia Muraviev | 2008-07-31 | no | http://encode.ru/threads/143-LZSS-v0-01-is-here! LZSS | Nobuo Ito | 1.0 | no | LZV1 | Hermann Vogt | 0.5 | no | http://encode.ru/threads/1661-LZWC-A-fast-tree-based-LZW-compressor lzx_compress | Matthew T. Russotto | 2005-07-06 | no | http://www.russotto.net/chm/ miniz | Richard Geldreich, Jr. | 1.11 | yes | https://code.google.com/p/miniz Nakamichi | Georgi Marinov | Aratama | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Butsuhira | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | ButsuhiraBranchless | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Daikuni | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Hanabi | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Hanazakari | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Hitomi | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Inazuma | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Jiten | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Kaibutsu | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Kaidanji FIX | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Kaiko | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Kinezumi | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Kinroba | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Kinutora | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Kitsune | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Kumataka | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Nekomata | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Nin | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Nirenpatsu | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Sanagi | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Sanbashi | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Sanrenpatsu | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Sanshi | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Suiken | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Tengu | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Washi | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Yoko | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | Georgi Marinov | Zangetsu | yes | http://www.sanmayce.com/Nakamichi/ Nakamichi | m^2, Georgi Marinov | M2.0 | yes | nrv2a | Markus Franz Xaver Johannes Oberhumer | 1.03 | no | www.oberhumer.com/opensource/ucl nrv2b | Markus Franz Xaver Johannes Oberhumer | 1.03 | no | www.oberhumer.com/opensource/ucl nrv2d | Markus Franz Xaver Johannes Oberhumer | 1.03 | no | www.oberhumer.com/opensource/ucl PostreSQL | Jan Wieck | 9.3.4 | no | http://www.postgresql.org/ QuickLZ | Lasse Mikkel Reinhold | 1.5.1b6 | yes | www.quicklz.com QuickLZ zip | Lasse Mikkel Reinhold | 0.4 | no | www.quicklz.com/zip.html RLE64 | Javier Gutiérrez Chamorro | R3.00 | no | http://nikkhokkho.sourceforge.net/static.php?page=RLE64 SCZ | Carl Kindman | 2008-11-25 | no | Shrinker | Fu Siyuan | r5 | yes | https://code.google.com/p/shrinker Snappy | ??? | 1.1.0 | yes | https://code.google.com/p/snappy tinf | Joergen Ibsen | 1.00 | no | http://ibsensoftware.com/download.html Tornado | Joachim Henke, Bulat Ziganshin | 0.6a | yes | http://freearc.org:8002 wfLZ | Shane Calimlim | r10 | yes | https://code.google.com/p/wflz/ Yappy | Peter Popov | v2 | yes | http://blog.gamedeff.com/?p=371 z3lib - deflate | Oskar Schirmer | 1.3 | no | http://scara.com/~schirmer/o/z3lib zlib - deflate | Mark Adler, Jean-loup Gailly | 1.2.8 | yes | http://zlib.net zlib - deflate, Intel version | Mark Adler, Jean-loup Gailly, Jim Kukunas | 2014-06-16 | no | https://github.com/jtkukunas/zlib zling | Zhang Li | 20140324 | yes | https://github.com/richox/libzling zopfli - deflate | Lode Vandevenne, Jyrki Alakuijala | 1.0.0 | yes | https://code.google.com/p/zopfli zstd | Yann Collet | 2015-01-31 | yes | https://github.com/Cyan4973/zstd ************************* Notes on included codecs: ************************* * many of them contain minor modifications to make them work with FsBench. I will only list the important ones. * In Yappy I added an option not to use SSE2 to improve portability. * In some cases I changed int types used when I encountered or expected portability problems. Should work exactly the same on intended platforms and also work on some more. * In BriefLZ the porting had to adjust some constants, which assumed 32-bit pointers. Also, because pointers are twice as big on 64-bit systems, effective memory capacity is halved, which reduces strength somewhat. * LZHAM uses 128 KB dictionary. It can be changed in sources. I intend to make it configurable from the command line later. * In lzx_compress I use a non-sliding window and lazy matching. Weirdly, the lzx_compress front-end doesn't use the sliding window version correctly. * I use BlueMidnightWish512 and 384 from the 1st instead of 2nd round of SHA3 competition because the latter doesn't work correctly on my system. It seems to be doing some out of bounds memory accesses. * z3lib asks for a number of compression parameters, documents allowed ranges, but not sensible defaults. I used all 0s, is it fine? I haven't wasted an evening to figure out. ************************* Notes on rejected codecs: ************************* * there were several codecs that I rejected because of their focus on education and goals of clarity over efficiency. I guess that most of them are not woth my time because benchmarka are all about efficiency. * codecs that are not FOSS, are not written in C(++) or are not written in English not to complicate things for myself. (Note: may introduce them later) * LZRW* - really, just historic codecs, very poor nowadays. Note: at the time of rejections fsbench has been much less maintainable than it is now. I may reintroduce LZRW* if convinced that it's useful. * snappy-c - I would really like to use it, but it's dependence on Linux kernel headers scares me off. Note: it's been said that the depencence has been removed. TOCHECK. * arjz - Looks like the code is only single threaded and would take considerable effort to make usable. * UC2 - Looks like the code is only single threaded and would take considerable effort to make usable. * lha - Unix only * ulha - Unix only * arj - x86 only * NTFS-3G - I tried, but got crashes. Took too much time to debug, I gave up. I may retry later. * LZP1 - Initially looked OK, but crashed sometimes. And it wasn't good anyway. * LZP2 - Kept crashing when compiled with mingw (both x86 and AMD64), so I didn't even try to integrate it with fsbench. * flzp - My initial tests showed that it was weak and slow. I guess that's because it has been designed to be used as a preprocessor... * zax - It seemed very immature. * I got crashes with 7zip's PPMD. The code base is terribly complicated and I decided that it's better to stay away than to debug * minihuff - requires one to have ready frequency statistics ************ Other notes: ************ * Some algorithms contain asm pieces. I never use them because that would be a big complication for me. ************ Known bugs: ************ * chaining codecs doesn't always work, schemes that involve compressor+compressor, compressor+encryption are broken