Get the most out of your Centmin Mod LEMP stack
Become a Member

CentOS 7.x Custom Rsync 3.2.3 RPM Builds With xxHash/zstd Support For CentOS 7

Discussion in 'Beta release code' started by eva2000, Dec 2, 2020.

Thread Status:
Not open for further replies.
  1. eva2000

    eva2000 Administrator Staff Member

    47,294
    10,705
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +16,631
    Local Time:
    9:54 AM
    Nginx 1.19.x
    MariaDB 5.5/10.x
    CentOS 7 comes with rsync 3.1.2 version by default. However, newer rsync 3.2 has added support for faster lz4 and zstd compression and faster xxHash hashing algorithms. Details at https://download.samba.org/pub/rsync/NEWS.

    I am privately testing custom built rsync 3.2.3 RPM binaries for CentOS 7 right now. No available for public consumption yet. But below are some example benchmarks results. You can jump straight to the latest charts/summary here and here. You can also pair rsync 3.2.3 with newer tar 1.32+ which also supports zstd compression.

    CentOS 7 native rsync 3.1.2
    Code (Text):
    rsync --version
    rsync  version 3.1.2  protocol version 31
    Copyright (C) 1996-2015 by Andrew Tridgell, Wayne Davison, and others.
    Web site: http://rsync.samba.org/
    Capabilities:
       64-bit files, 64-bit inums, 64-bit timestamps, 64-bit long ints,
       socketpairs, hardlinks, symlinks, IPv6, batchfiles, inplace,
       append, ACLs, xattrs, iconv, symtimes, prealloc
    
    rsync comes with ABSOLUTELY NO WARRANTY.  This is free software, and you
    are welcome to redistribute it under certain conditions.  See the GNU
    General Public Licence for details.
    



    Custom built rsync 3.2.3 RPM binaries one for avx2 supported cpus and one for non-avx2 older cpus.

    no avx2 support

    Code (Text):
    rsync --version
    rsync  version 3.2.3  protocol version 31
    Copyright (C) 1996-2020 by Andrew Tridgell, Wayne Davison, and others.
    Web site: https://rsync.samba.org/
    Capabilities:
       64-bit files, 64-bit inums, 64-bit timestamps, 64-bit long ints,
       socketpairs, hardlinks, hardlink-specials, symlinks, IPv6, atimes,
       batchfiles, inplace, append, ACLs, xattrs, optional protect-args, iconv,
       symtimes, prealloc, stop-at, no crtimes
    Optimizations:
       SIMD, asm, openssl-crypto
    Checksum list:
       xxh128 xxh3 xxh64 (xxhash) md5 md4 none
    Compress list:
       zstd lz4 zlibx zlib none
    
    rsync comes with ABSOLUTELY NO WARRANTY.  This is free software, and you
    are welcome to redistribute it under certain conditions.  See the GNU
    General Public Licence for details.

    Code (Text):
    yum -q info rsync-custom-noavx2-3.2.3
    Installed Packages
    Name        : rsync-custom-noavx2
    Arch        : x86_64
    Version     : 3.2.3
    Release     : 1.el7
    Size        : 877 k
    Repo        : installed
    From repo   : /rsync-custom-noavx2-3.2.3-1.el7.x86_64
    Summary     : rsync 3.2.3 (noavx2) for centminmod.com LEMP stack
    URL         : https://centminmod.com
    License     : unknown
    Description : rsync 3.2.3 (noavx2) for centminmod.com LEMP stacks


    avx2 support
    Code (Text):
    rsync --version
    rsync  version 3.2.3  protocol version 31
    Copyright (C) 1996-2020 by Andrew Tridgell, Wayne Davison, and others.
    Web site: https://rsync.samba.org/
    Capabilities:
       64-bit files, 64-bit inums, 64-bit timestamps, 64-bit long ints,
       socketpairs, hardlinks, hardlink-specials, symlinks, IPv6, atimes,
       batchfiles, inplace, append, ACLs, xattrs, optional protect-args, iconv,
       symtimes, prealloc, stop-at, no crtimes
    Optimizations:
       SIMD, asm, openssl-crypto
    Checksum list:
       xxh64 (xxhash) md5 md4 none
    Compress list:
       zstd lz4 zlibx zlib none
    
    rsync comes with ABSOLUTELY NO WARRANTY.  This is free software, and you
    are welcome to redistribute it under certain conditions.  See the GNU
    General Public Licence for details.

    Code (Text):
    yum -q info rsync-custom-avx2-3.2.3
    Installed Packages
    Name        : rsync-custom-avx2
    Arch        : x86_64
    Version     : 3.2.3
    Release     : 1.el7
    Size        : 873 k
    Repo        : installed
    From repo   : /rsync-custom-avx2-3.2.3-1.el7.x86_64
    Summary     : rsync 3.2.3 (avx2) for centminmod.com LEMP stack
    URL         : https://centminmod.com
    License     : unknown
    Description : rsync 3.2.3 (avx2) for centminmod.com LEMP stacks


    rsync 3.2.3 help
    Code (Text):
    rsync --help
    rsync  version 3.2.3  protocol version 31
    Copyright (C) 1996-2020 by Andrew Tridgell, Wayne Davison, and others.
    Web site: https://rsync.samba.org/
    Capabilities:
        64-bit files, 64-bit inums, 64-bit timestamps, 64-bit long ints,
        socketpairs, hardlinks, hardlink-specials, symlinks, IPv6, atimes,
        batchfiles, inplace, append, ACLs, xattrs, optional protect-args, iconv,
        symtimes, prealloc, stop-at, no crtimes
    Optimizations:
        SIMD, asm, openssl-crypto
    Checksum list:
        xxh64 (xxhash) md5 md4 none
    Compress list:
        zstd lz4 zlibx zlib none
    rsync comes with ABSOLUTELY NO WARRANTY.  This is free software, and you
    are welcome to redistribute it under certain conditions.  See the GNU
    General Public Licence for details.
    rsync is a file transfer program capable of efficient remote update
    via a fast differencing algorithm.
    Usage: rsync [OPTION]... SRC [SRC]... DEST
      or   rsync [OPTION]... SRC [SRC]... [USER@]HOST:DEST
      or   rsync [OPTION]... SRC [SRC]... [USER@]HOST::DEST
      or   rsync [OPTION]... SRC [SRC]... rsync://[USER@]HOST[:PORT]/DEST
      or   rsync [OPTION]... [USER@]HOST:SRC [DEST]
      or   rsync [OPTION]... [USER@]HOST::SRC [DEST]
      or   rsync [OPTION]... rsync://[USER@]HOST[:PORT]/SRC [DEST]
    The ':' usages connect via remote shell, while '::' & 'rsync://' usages connect
    to an rsync daemon, and require SRC or DEST to start with a module name.
    Options
    --verbose, -v            increase verbosity
    --info=FLAGS             fine-grained informational verbosity
    --debug=FLAGS            fine-grained debug verbosity
    --stderr=e|a|c           change stderr output mode (default: errors)
    --quiet, -q              suppress non-error messages
    --no-motd                suppress daemon-mode MOTD
    --checksum, -c           skip based on checksum, not mod-time & size
    --archive, -a            archive mode; equals -rlptgoD (no -H,-A,-X)
    --no-OPTION              turn off an implied OPTION (e.g. --no-D)
    --recursive, -r          recurse into directories
    --relative, -R           use relative path names
    --no-implied-dirs        don't send implied dirs with --relative
    --backup, -b             make backups (see --suffix & --backup-dir)
    --backup-dir=DIR         make backups into hierarchy based in DIR
    --suffix=SUFFIX          backup suffix (default ~ w/o --backup-dir)
    --update, -u             skip files that are newer on the receiver
    --inplace                update destination files in-place
    --append                 append data onto shorter files
    --append-verify          --append w/old data in file checksum
    --dirs, -d               transfer directories without recursing
    --mkpath                 create the destination's path component
    --links, -l              copy symlinks as symlinks
    --copy-links, -L         transform symlink into referent file/dir
    --copy-unsafe-links      only "unsafe" symlinks are transformed
    --safe-links             ignore symlinks that point outside the tree
    --munge-links            munge symlinks to make them safe & unusable
    --copy-dirlinks, -k      transform symlink to dir into referent dir
    --keep-dirlinks, -K      treat symlinked dir on receiver as dir
    --hard-links, -H         preserve hard links
    --perms, -p              preserve permissions
    --executability, -E      preserve executability
    --chmod=CHMOD            affect file and/or directory permissions
    --acls, -A               preserve ACLs (implies --perms)
    --xattrs, -X             preserve extended attributes
    --owner, -o              preserve owner (super-user only)
    --group, -g              preserve group
    --devices                preserve device files (super-user only)
    --specials               preserve special files
    -D                       same as --devices --specials
    --times, -t              preserve modification times
    --atimes, -U             preserve access (use) times
    --open-noatime           avoid changing the atime on opened files
    --crtimes, -N            preserve create times (newness)
    --omit-dir-times, -O     omit directories from --times
    --omit-link-times, -J    omit symlinks from --times
    --super                  receiver attempts super-user activities
    --fake-super             store/recover privileged attrs using xattrs
    --sparse, -S             turn sequences of nulls into sparse blocks
    --preallocate            allocate dest files before writing them
    --write-devices          write to devices as files (implies --inplace)
    --dry-run, -n            perform a trial run with no changes made
    --whole-file, -W         copy files whole (w/o delta-xfer algorithm)
    --checksum-choice=STR    choose the checksum algorithm (aka --cc)
    --one-file-system, -x    don't cross filesystem boundaries
    --block-size=SIZE, -B    force a fixed checksum block-size
    --rsh=COMMAND, -e        specify the remote shell to use
    --rsync-path=PROGRAM     specify the rsync to run on remote machine
    --existing               skip creating new files on receiver
    --ignore-existing        skip updating files that exist on receiver
    --remove-source-files    sender removes synchronized files (non-dir)
    --del                    an alias for --delete-during
    --delete                 delete extraneous files from dest dirs
    --delete-before          receiver deletes before xfer, not during
    --delete-during          receiver deletes during the transfer
    --delete-delay           find deletions during, delete after
    --delete-after           receiver deletes after transfer, not during
    --delete-excluded        also delete excluded files from dest dirs
    --ignore-missing-args    ignore missing source args without error
    --delete-missing-args    delete missing source args from destination
    --ignore-errors          delete even if there are I/O errors
    --force                  force deletion of dirs even if not empty
    --max-delete=NUM         don't delete more than NUM files
    --max-size=SIZE          don't transfer any file larger than SIZE
    --min-size=SIZE          don't transfer any file smaller than SIZE
    --max-alloc=SIZE         change a limit relating to memory alloc
    --partial                keep partially transferred files
    --partial-dir=DIR        put a partially transferred file into DIR
    --delay-updates          put all updated files into place at end
    --prune-empty-dirs, -m   prune empty directory chains from file-list
    --numeric-ids            don't map uid/gid values by user/group name
    --usermap=STRING         custom username mapping
    --groupmap=STRING        custom groupname mapping
    --chown=USER:GROUP       simple username/groupname mapping
    --timeout=SECONDS        set I/O timeout in seconds
    --contimeout=SECONDS     set daemon connection timeout in seconds
    --ignore-times, -I       don't skip files that match size and time
    --size-only              skip files that match in size
    --modify-window=NUM, -@  set the accuracy for mod-time comparisons
    --temp-dir=DIR, -T       create temporary files in directory DIR
    --fuzzy, -y              find similar file for basis if no dest file
    --compare-dest=DIR       also compare destination files relative to DIR
    --copy-dest=DIR          ... and include copies of unchanged files
    --link-dest=DIR          hardlink to files in DIR when unchanged
    --compress, -z           compress file data during the transfer
    --compress-choice=STR    choose the compression algorithm (aka --zc)
    --compress-level=NUM     explicitly set compression level (aka --zl)
    --skip-compress=LIST     skip compressing files with suffix in LIST
    --cvs-exclude, -C        auto-ignore files in the same way CVS does
    --filter=RULE, -f        add a file-filtering RULE
    -F                       same as --filter='dir-merge /.rsync-filter'
                             repeated: --filter='- .rsync-filter'
    --exclude=PATTERN        exclude files matching PATTERN
    --exclude-from=FILE      read exclude patterns from FILE
    --include=PATTERN        don't exclude files matching PATTERN
    --include-from=FILE      read include patterns from FILE
    --files-from=FILE        read list of source-file names from FILE
    --from0, -0              all *-from/filter files are delimited by 0s
    --protect-args, -s       no space-splitting; wildcard chars only
    --copy-as=USER[:GROUP]   specify user & optional group for the copy
    --address=ADDRESS        bind address for outgoing socket to daemon
    --port=PORT              specify double-colon alternate port number
    --sockopts=OPTIONS       specify custom TCP options
    --blocking-io            use blocking I/O for the remote shell
    --outbuf=N|L|B           set out buffering to None, Line, or Block
    --stats                  give some file-transfer stats
    --8-bit-output, -8       leave high-bit chars unescaped in output
    --human-readable, -h     output numbers in a human-readable format
    --progress               show progress during transfer
    -P                       same as --partial --progress
    --itemize-changes, -i    output a change-summary for all updates
    --remote-option=OPT, -M  send OPTION to the remote side only
    --out-format=FORMAT      output updates using the specified FORMAT
    --log-file=FILE          log what we're doing to the specified FILE
    --log-file-format=FMT    log updates using the specified FMT
    --password-file=FILE     read daemon-access password from FILE
    --early-input=FILE       use FILE for daemon's early exec input
    --list-only              list the files instead of copying them
    --bwlimit=RATE           limit socket I/O bandwidth
    --stop-after=MINS        Stop rsync after MINS minutes have elapsed
    --stop-at=y-m-dTh:m      Stop rsync at the specified point in time
    --write-batch=FILE       write a batched update to FILE
    --only-write-batch=FILE  like --write-batch but w/o updating dest
    --read-batch=FILE        read a batched update from FILE
    --protocol=NUM           force an older protocol version to be used
    --iconv=CONVERT_SPEC     request charset conversion of filenames
    --checksum-seed=NUM      set block/file checksum seed (advanced)
    --ipv4, -4               prefer IPv4
    --ipv6, -6               prefer IPv6
    --version, -V            print the version + other info and exit
    --help, -h (*)           show this help (* -h is help only on its own)
    Use "rsync --daemon --help" to see the daemon-mode command-line options.
    Please see the rsync(1) and rsyncd.conf(5) man pages for full documentation.
    See https://rsync.samba.org/ for updates, bug reports, and answers
    

    Choosing zstd compression for rsync via --compress-choice=zstd or --zc zstd flags. Custom rsync 3.2.3 supports the following compression algorithms = zstd, lz4, zlibx, zlib and none
    Code (Text):
    rsync --help | grep '\-\-z'
    --compress-choice=STR    choose the compression algorithm (aka --zc)
    --compress-level=NUM     explicitly set compression level (aka --zl)
    

    Choosing checksum method via --checksum-choice= or --cc
    Code (Text):
    rsync --help | grep '\-\-cc'
    --checksum-choice=STR    choose the checksum algorithm (aka --cc)
    

    Examples

    with checksum md5 and zstd compression
    Code (Text):
    rsync -avzin --cc md5 --zc zstd zcat-test/ zcat-test-dst/
    sending incremental file list
    .d..t...... ./
    >f+++++++++ access_log_20180428-234724.log.gz
    >f+++++++++ access_log_20180428-234724.log.zst
    >f+++++++++ access_log_20180429-005239.log.gz
    >f+++++++++ access_log_20180429-005239.log.zst
    >f+++++++++ access_log_20180429-012648.log.gz
    >f+++++++++ access_log_20180429-012648.log.zst
    sent 214 bytes  received 37 bytes  502.00 bytes/sec
    total size is 263,394,826  speedup is 1,049,381.78 (DRY RUN)
    

    with checksum xxhash (you can't use xxhash64) and zstd
    Code (Text):
    rsync -avzin --cc xxhash --zc zstd zcat-test/ zcat-test-dst/
    sending incremental file list
    .d..t...... ./
    >f+++++++++ access_log_20180428-234724.log.gz
    >f+++++++++ access_log_20180428-234724.log.zst
    >f+++++++++ access_log_20180429-005239.log.gz
    >f+++++++++ access_log_20180429-005239.log.zst
    >f+++++++++ access_log_20180429-012648.log.gz
    >f+++++++++ access_log_20180429-012648.log.zst
    sent 214 bytes  received 37 bytes  502.00 bytes/sec
    total size is 263,394,826  speedup is 1,049,381.78 (DRY RUN)
    

    Code (Text):
    rsync -avzin --cc xxhash64 --zc zstd zcat-test/ zcat-test-dst/
    unknown checksum name: xxhash64
    rsync error: requested action not supported (code 4) at checksum.c(86) [client=3.2.3]
    


    rsync 3.2 non-avx2 benchmarks



    Testing various combinations of compression algorithms from zstd, zlibx and lz4 and checksums, md5 and xxhash.

    Tests done on non-avx2 supported dedicated server with Xeon E3-1230v2 IvyBridge cpu.
    Code (Text):
    lscpu
    Architecture:          x86_64
    CPU op-mode(s):        32-bit, 64-bit
    Byte Order:            Little Endian
    CPU(s):                8
    On-line CPU(s) list:   0-7
    Thread(s) per core:    2
    Core(s) per socket:    4
    Socket(s):             1
    NUMA node(s):          1
    Vendor ID:             GenuineIntel
    CPU family:            6
    Model:                 58
    Model name:            Intel(R) Xeon(R) CPU E3-1230 V2 @ 3.30GHz
    Stepping:              9
    CPU MHz:               3496.984
    CPU max MHz:           3700.0000
    CPU min MHz:           1600.0000
    BogoMIPS:              6599.85
    Virtualization:        VT-x
    L1d cache:             32K
    L1i cache:             32K
    L2 cache:              256K
    L3 cache:              8192K
    NUMA node0 CPU(s):     0-7
    Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d
    


    md5 + zstd
    Code (Text):
    time rsync -avzi --cc md5 --zc zstd zcat-test/ zcat-test-dst/
    sending incremental file list
    .d..t...... ./
    >f+++++++++ access_log_20180428-234724.log.gz
    >f+++++++++ access_log_20180428-234724.log.zst
    >f+++++++++ access_log_20180429-005239.log.gz
    >f+++++++++ access_log_20180429-005239.log.zst
    >f+++++++++ access_log_20180429-012648.log.gz
    >f+++++++++ access_log_20180429-012648.log.zst
    sent 263,454,871 bytes  received 133 bytes  526,910,008.00 bytes/sec
    total size is 263,394,826  speedup is 1.00
    real    0m0.798s
    user    0m1.149s
    sys     0m0.195s
    

    md5 + zlibx
    Code (Text):
    time rsync -avzi --cc md5 --zc zlibx zcat-test/ zcat-test-dst/
    sending incremental file list
    .d..t...... ./
    >f+++++++++ access_log_20180428-234724.log.gz
    >f+++++++++ access_log_20180428-234724.log.zst
    >f+++++++++ access_log_20180429-005239.log.gz
    >f+++++++++ access_log_20180429-005239.log.zst
    >f+++++++++ access_log_20180429-012648.log.gz
    >f+++++++++ access_log_20180429-012648.log.zst
    sent 263,505,107 bytes  received 133 bytes  175,670,160.00 bytes/sec
    total size is 263,394,826  speedup is 1.00
    real    0m1.406s
    user    0m1.726s
    sys     0m0.214s
    

    md5 + lz4
    Code (Text):
    time rsync -avzi --cc md5 --zc lz4 zcat-test/ zcat-test-dst/
    sending incremental file list
    .d..t...... ./
    >f+++++++++ access_log_20180428-234724.log.gz
    >f+++++++++ access_log_20180428-234724.log.zst
    >f+++++++++ access_log_20180429-005239.log.gz
    >f+++++++++ access_log_20180429-005239.log.zst
    >f+++++++++ access_log_20180429-012648.log.gz
    >f+++++++++ access_log_20180429-012648.log.zst
    sent 264,571,058 bytes  received 133 bytes  176,380,794.00 bytes/sec
    total size is 263,394,826  speedup is 1.00
    real    0m0.666s
    user    0m0.980s
    sys     0m0.184s
    

    xxhash + zstd
    Code (Text):
    time rsync -avzi --cc xxhash --zc zstd zcat-test/ zcat-test-dst/
    sending incremental file list
    .d..t...... ./
    >f+++++++++ access_log_20180428-234724.log.gz
    >f+++++++++ access_log_20180428-234724.log.zst
    >f+++++++++ access_log_20180429-005239.log.gz
    >f+++++++++ access_log_20180429-005239.log.zst
    >f+++++++++ access_log_20180429-012648.log.gz
    >f+++++++++ access_log_20180429-012648.log.zst
    sent 263,454,823 bytes  received 133 bytes  526,909,912.00 bytes/sec
    total size is 263,394,826  speedup is 1.00
    real    0m0.424s
    user    0m0.426s
    sys     0m0.181s
    

    xxhash + zlibx
    Code (Text):
    time rsync -avzi --cc xxhash --zc zlibx zcat-test/ zcat-test-dst/
    sending incremental file list
    .d..t...... ./
    >f+++++++++ access_log_20180428-234724.log.gz
    >f+++++++++ access_log_20180428-234724.log.zst
    >f+++++++++ access_log_20180429-005239.log.gz
    >f+++++++++ access_log_20180429-005239.log.zst
    >f+++++++++ access_log_20180429-012648.log.gz
    >f+++++++++ access_log_20180429-012648.log.zst
    sent 263,505,059 bytes  received 133 bytes  175,670,128.00 bytes/sec
    total size is 263,394,826  speedup is 1.00
    real    0m1.044s
    user    0m1.015s
    sys     0m0.198s
    

    xxhash + lz4
    Code (Text):
    time rsync -avzi --cc xxhash --zc lz4 zcat-test/ zcat-test-dst/
    sending incremental file list
    .d..t...... ./
    >f+++++++++ access_log_20180428-234724.log.gz
    >f+++++++++ access_log_20180428-234724.log.zst
    >f+++++++++ access_log_20180429-005239.log.gz
    >f+++++++++ access_log_20180429-005239.log.zst
    >f+++++++++ access_log_20180429-012648.log.gz
    >f+++++++++ access_log_20180429-012648.log.zst
    sent 264,571,010 bytes  received 133 bytes  529,142,286.00 bytes/sec
    total size is 263,394,826  speedup is 1.00
    real    0m0.326s
    user    0m0.266s
    sys     0m0.177s
    

    rsync 3.2 no-avx2 benchmark results where lower time = faster.
    • md5 + zstd = 0.798s sent 263,454,871 bytes
    • md5 + zlibx = 1.406s sent 263,505,107 bytes
    • md5 + lz4 = 0.666s sent 264,571,058 bytes
    • xxhash + zstd = 0.424s sent 263,454,823 bytes
    • xxhash + zlibx = 1.044s sent 263,505,059 bytes
    • xxhash + lz4 = 0.326s sent 264,571,010 bytes

    rsync 3.2 avx2 benchmarks



    Testing various combinations of compression algorithms from zstd, zlibx and lz4 and checksums, md5 and xxhash.

    Tests done on non-avx2 supported dedicated server with Intel Core i7 4790K Haswell cpu.
    Code (Text):
    lscpu
    Architecture:          x86_64
    CPU op-mode(s):        32-bit, 64-bit
    Byte Order:            Little Endian
    CPU(s):                8
    On-line CPU(s) list:   0-7
    Thread(s) per core:    2
    Core(s) per socket:    4
    Socket(s):             1
    NUMA node(s):          1
    Vendor ID:             GenuineIntel
    CPU family:            6
    Model:                 60
    Model name:            Intel(R) Core(TM) i7-4790K CPU @ 4.00GHz
    Stepping:              3
    CPU MHz:               4199.951
    CPU max MHz:           4400.0000
    CPU min MHz:           800.0000
    BogoMIPS:              7982.22
    Virtualization:        VT-x
    L1d cache:             32K
    L1i cache:             32K
    L2 cache:              256K
    L3 cache:              8192K
    NUMA node0 CPU(s):     0-7
    Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm epb invpcid_single ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid xsaveopt dtherm ida arat pln pts md_clear spec_ctrl intel_stibp flush_l1d
    


    md5 + zstd
    Code (Text):
    time rsync -avzi --cc md5 --zc zstd zcat-test/ zcat-test-dst/
    sending incremental file list
    .d..t...... ./
    >f+++++++++ access_log_20180428-234724.log.gz
    >f+++++++++ access_log_20180428-234724.log.zst
    >f+++++++++ access_log_20180429-005239.log.gz
    >f+++++++++ access_log_20180429-005239.log.zst
    >f+++++++++ access_log_20180429-012648.log.gz
    >f+++++++++ access_log_20180429-012648.log.zst
    sent 263,454,894 bytes  received 133 bytes  526,910,054.00 bytes/sec
    total size is 263,394,826  speedup is 1.00
    real    0m0.670s
    user    0m0.898s
    sys     0m0.212s
    


    md5 + zlibx
    Code (Text):
    time rsync -avzi --cc md5 --zc zlibx zcat-test/ zcat-test-dst/
    sending incremental file list
    .d..t...... ./
    >f+++++++++ access_log_20180428-234724.log.gz
    >f+++++++++ access_log_20180428-234724.log.zst
    >f+++++++++ access_log_20180429-005239.log.gz
    >f+++++++++ access_log_20180429-005239.log.zst
    >f+++++++++ access_log_20180429-012648.log.gz
    >f+++++++++ access_log_20180429-012648.log.zst
    sent 263,505,130 bytes  received 133 bytes  175,670,175.33 bytes/sec
    total size is 263,394,826  speedup is 1.00
    real    0m1.184s
    user    0m1.415s
    sys     0m0.244s
    


    md5 + lz4
    Code (Text):
    time rsync -avzi --cc md5 --zc lz4 zcat-test/ zcat-test-dst/
    sending incremental file list
    .d..t...... ./
    >f+++++++++ access_log_20180428-234724.log.gz
    >f+++++++++ access_log_20180428-234724.log.zst
    >f+++++++++ access_log_20180429-005239.log.gz
    >f+++++++++ access_log_20180429-005239.log.zst
    >f+++++++++ access_log_20180429-012648.log.gz
    >f+++++++++ access_log_20180429-012648.log.zst
    sent 264,571,081 bytes  received 133 bytes  529,142,428.00 bytes/sec
    total size is 263,394,826  speedup is 1.00
    real    0m0.583s
    user    0m0.786s
    sys     0m0.222s
    


    xxhash + zstd
    Code (Text):
    time rsync -avzi --cc xxhash --zc zstd zcat-test/ zcat-test-dst/
    sending incremental file list
    .d..t...... ./
    >f+++++++++ access_log_20180428-234724.log.gz
    >f+++++++++ access_log_20180428-234724.log.zst
    >f+++++++++ access_log_20180429-005239.log.gz
    >f+++++++++ access_log_20180429-005239.log.zst
    >f+++++++++ access_log_20180429-012648.log.gz
    >f+++++++++ access_log_20180429-012648.log.zst
    sent 263,454,846 bytes  received 133 bytes  526,909,958.00 bytes/sec
    total size is 263,394,826  speedup is 1.00
    real    0m0.365s
    user    0m0.320s
    sys     0m0.206s
    


    xxhash + zlibx
    Code (Text):
    time rsync -avzi --cc xxhash --zc zlibx zcat-test/ zcat-test-dst/
    sending incremental file list
    .d..t...... ./
    >f+++++++++ access_log_20180428-234724.log.gz
    >f+++++++++ access_log_20180428-234724.log.zst
    >f+++++++++ access_log_20180429-005239.log.gz
    >f+++++++++ access_log_20180429-005239.log.zst
    >f+++++++++ access_log_20180429-012648.log.gz
    >f+++++++++ access_log_20180429-012648.log.zst
    sent 263,505,082 bytes  received 133 bytes  175,670,143.33 bytes/sec
    total size is 263,394,826  speedup is 1.00
    real    0m0.890s
    user    0m0.840s
    sys     0m0.230s
    


    xxhash + lz4
    Code (Text):
    time rsync -avzi --cc xxhash --zc lz4 zcat-test/ zcat-test-dst/
    sending incremental file list
    .d..t...... ./
    >f+++++++++ access_log_20180428-234724.log.gz
    >f+++++++++ access_log_20180428-234724.log.zst
    >f+++++++++ access_log_20180429-005239.log.gz
    >f+++++++++ access_log_20180429-005239.log.zst
    >f+++++++++ access_log_20180429-012648.log.gz
    >f+++++++++ access_log_20180429-012648.log.zst
    sent 264,571,033 bytes  received 133 bytes  176,380,777.33 bytes/sec
    total size is 263,394,826  speedup is 1.00
    real    0m0.322s
    user    0m0.207s
    sys     0m0.212s
    


    and default CentOS 7 rsync 3.1.2 with -z compress flag
    Code (Text):
    time /usr/bin/rsync -avzi zcat-test/ zcat-test-dst/
    sending incremental file list
    .d..t...... ./
    >f+++++++++ access_log_20180428-234724.log.gz
    >f+++++++++ access_log_20180428-234724.log.zst
    >f+++++++++ access_log_20180429-005239.log.gz
    >f+++++++++ access_log_20180429-005239.log.zst
    >f+++++++++ access_log_20180429-012648.log.gz
    >f+++++++++ access_log_20180429-012648.log.zst
    sent 263,545,200 bytes  received 133 bytes  40,545,435.85 bytes/sec
    total size is 263,394,826  speedup is 1.00
    real    0m6.095s
    user    0m6.392s
    sys     0m0.269s
    

    default CentOS 7 rsync 3.1.2 without -z compress flag
    Code (Text):
    time /usr/bin/rsync -avi zcat-test/ zcat-test-dst/  
    sending incremental file list
    .d..t...... ./
    >f+++++++++ access_log_20180428-234724.log.gz
    >f+++++++++ access_log_20180428-234724.log.zst
    >f+++++++++ access_log_20180429-005239.log.gz
    >f+++++++++ access_log_20180429-005239.log.zst
    >f+++++++++ access_log_20180429-012648.log.gz
    >f+++++++++ access_log_20180429-012648.log.zst
    sent 263,459,568 bytes  received 133 bytes  526,919,402.00 bytes/sec
    total size is 263,394,826  speedup is 1.00
    real    0m0.519s
    user    0m0.693s
    sys     0m0.251s
    

    and rsync 3.2.3 with no flags to replicate 3.1.2 previous test
    Code (Text):
    time /usr/local/bin/rsync -avzi zcat-test/ zcat-test-dst/
    sending incremental file list
    .d..t...... ./
    >f+++++++++ access_log_20180428-234724.log.gz
    >f+++++++++ access_log_20180428-234724.log.zst
    >f+++++++++ access_log_20180429-005239.log.gz
    >f+++++++++ access_log_20180429-005239.log.zst
    >f+++++++++ access_log_20180429-012648.log.gz
    >f+++++++++ access_log_20180429-012648.log.zst
    sent 263,454,894 bytes  received 133 bytes  526,910,054.00 bytes/sec
    total size is 263,394,826  speedup is 1.00
    real    0m0.364s
    user    0m0.313s
    sys     0m0.210s
    


    Benchmark comparison for rsync 3.1.2 native CentOS 7 binary versus rsync 3.2.3 built RPM binary on avx2 system with Intel Core i7 4790K Haswell cpu for 6x compressed log file rync on same system disk. Looks like rsync 3.2.3 no flags defaults to xxhash + zstd and is ~29.87% faster than rsync 3.1.2 without -z flag and ~94.03% faster than rsync 3.1.2 with -z flag - making rsync 3.2.3 a good candidate if you're rsync transferring a mix of compressed and uncompressed files together.

    rsync 3.2 avx2 benchmark results where lower time = faster.
    • default CentOS 7 rsync 3.1.2 with -z compress = 6.095s (sent 263,545,200 bytes)
    • default CentOS 7 rsync 3.1.2 without -z compress = 0.519s (sent 263,459,568 bytes)
    • rsync 3.2.3 no flags default with -z compress = 0.364s (sent 263,454,894 bytes)
    • md5 + zstd with -z compress = 0.670s (sent 263,454,894 bytes)
    • md5 + zlibx with -z compress = 1.184s (sent 263,505,130 bytes)
    • md5 + lz4 with -z compress = 0.583s (sent 264,571,081 bytes)
    • xxhash + zstd with -z compress = 0.365s (sent 263,454,846 bytes)
    • xxhash + zlibx with -z compress = 0.890s (sent 263,505,082 bytes)
    • xxhash + lz4 with -z compress = 0.322s (sent 264,571,033 bytes)
    size of source directory is 252MB
    Code (Text):
    du -sh zcat-test
    252M    zcat-test
    
     
  2. eva2000

    eva2000 Administrator Staff Member

    47,294
    10,705
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +16,631
    Local Time:
    9:54 AM
    Nginx 1.19.x
    MariaDB 5.5/10.x

    Rsync 3.2.3 Benchmarks Part 2



    To make it easier to benchmark, I wrote a shell script to run through all the possible rsync combinations and extend the previous test with adding a bunch of files to source directory.
    • Using Rsync 3.2.3 avx2 built RPM binary on Intel Core i7 4790K Haswell cpu
    • Rsync transfer /home/rsync-test/ to /home/rsync-test-dst with 2,850 files totaling 746MB in size of which 6x files are already compressed log files from Part 1 benchmarks and other files are files copied over from Centmin Mod log directory at /root/centminlogs.
    • Looks like once you mix in normal uncompressed files in Rsync transfer, then zstd and lz4 are not necessarily the fastest for Rsync transfers. However, really depends on what type of files you're transferring I guess.

    Code (Text):
    ls -lah /home/rsync-test/ | wc -l
    2850
    
    du -sh /home/rsync-test/
    746M    /home/rsync-test/
    


    Rsync 3.1.2 Native results



    First run is compressed and second run is non-compressed

    Code (Text):
    ./rsync-benchmark.sh bench-native /home/rsync-test/ /home/rsync-test-dst/ 
    /usr/bin/rsync -avzi --stats --log-file=/home/rsync-benchmarks/rsyncbench-rsync-native-compressed-041220-152245.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.1.2 native compressed] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.1.2 native compressed] total bytes: 773951797 sent bytes: 319193453 (22017073.45 per second)
    [rsync 3.1.2 native compressed] transfer speed (MB/s): 21.1393 speedup: 2.42
    [rsync 3.1.2 native compressed] real: 14.40s user: 14.78s sys: 0.86s cpu: 108% maxmem: 2320 KB cswaits: 12206
    
    /usr/bin/rsync -avi --stats --log-file=/home/rsync-benchmarks/rsyncbench-rsync-native-no-compress-041220-152245.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.1.2 native no-compress] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.1.2 native no-compress] total bytes: 773951797 sent bytes: 774437612 (221283349.71 per second)
    [rsync 3.1.2 native no-compress] transfer speed (MB/s): 243.7495 speedup: 1.00
    [rsync 3.1.2 native no-compress] real: 3.03s user: 2.21s sys: 0.88s cpu: 101% maxmem: 1992 KB cswaits: 22366
    


    Rsync 3.2.3 results



    Below results test all combinations of check sum hashing algorithms, xxh128, xxh3, xxh64, xxhash, and md5 with compression algorithms lz4, zstd, zlib and none.

    with lz4
    Code (Text):
    ./rsync-benchmark.sh bench /home/rsync-test/ /home/rsync-test-dst/        
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc lz4 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-lz4-041220-152607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-lz4] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-lz4] total bytes: 773951797 sent bytes: 385178200 (110066374.86 per second)
    [rsync 3.2.3 xxh128-lz4] transfer speed (MB/s): 153.0560 speedup: 2.01
    [rsync 3.2.3 xxh128-lz4] real: 2.40s user: 0.93s sys: 0.77s cpu: 70% maxmem: 2832 KB cswaits: 12403
    
    /usr/local/bin/rsync -avzi --stats --cc xxh3 --zc lz4 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh3-lz4-041220-152607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh3-lz4] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh3-lz4] total bytes: 773951797 sent bytes: 385155424 (110059867.43 per second)
    [rsync 3.2.3 xxh3-lz4] transfer speed (MB/s): 143.4815 speedup: 2.01
    [rsync 3.2.3 xxh3-lz4] real: 2.56s user: 0.89s sys: 0.80s cpu: 66% maxmem: 2828 KB cswaits: 12426
    
    /usr/local/bin/rsync -avzi --stats --cc xxh64 --zc lz4 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh64-lz4-041220-152607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh64-lz4] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh64-lz4] total bytes: 773951797 sent bytes: 385155424 (110059867.43 per second)
    [rsync 3.2.3 xxh64-lz4] transfer speed (MB/s): 135.0414 speedup: 2.01
    [rsync 3.2.3 xxh64-lz4] real: 2.72s user: 1.10s sys: 0.93s cpu: 75% maxmem: 2820 KB cswaits: 12296
    
    /usr/local/bin/rsync -avzi --stats --cc xxhash --zc lz4 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxhash-lz4-041220-152607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxhash-lz4] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxhash-lz4] total bytes: 773951797 sent bytes: 385155424 (110059867.43 per second)
    [rsync 3.2.3 xxhash-lz4] transfer speed (MB/s): 141.8196 speedup: 2.01
    [rsync 3.2.3 xxhash-lz4] real: 2.59s user: 0.92s sys: 0.79s cpu: 65% maxmem: 2824 KB cswaits: 12424
    
    /usr/local/bin/rsync -avzi --stats --cc md5 --zc lz4 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-md5-lz4-041220-152607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 md5-lz4] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 md5-lz4] total bytes: 773951797 sent bytes: 385178200 (110066374.86 per second)
    [rsync 3.2.3 md5-lz4] transfer speed (MB/s): 106.7833 speedup: 2.01
    [rsync 3.2.3 md5-lz4] real: 3.44s user: 2.80s sys: 0.84s cpu: 105% maxmem: 2832 KB cswaits: 10194
    

    with zstd
    Code (Text):
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-041220-152607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd] total bytes: 773951797 sent bytes: 303996691 (86871658.00 per second)
    [rsync 3.2.3 xxh128-zstd] transfer speed (MB/s): 96.6379 speedup: 2.55
    [rsync 3.2.3 xxh128-zstd] real: 3.00s user: 1.84s sys: 0.91s cpu: 91% maxmem: 6248 KB cswaits: 9046
    
    /usr/local/bin/rsync -avzi --stats --cc xxh3 --zc zstd --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh3-zstd-041220-152607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh3-zstd] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh3-zstd] total bytes: 773951797 sent bytes: 303973911 (86865149.43 per second)
    [rsync 3.2.3 xxh3-zstd] transfer speed (MB/s): 101.0077 speedup: 2.55
    [rsync 3.2.3 xxh3-zstd] real: 2.87s user: 1.63s sys: 0.79s cpu: 84% maxmem: 6240 KB cswaits: 8751
    
    /usr/local/bin/rsync -avzi --stats --cc xxh64 --zc zstd --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh64-zstd-041220-152607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh64-zstd] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh64-zstd] total bytes: 773951797 sent bytes: 303973911 (86865149.43 per second)
    [rsync 3.2.3 xxh64-zstd] transfer speed (MB/s): 103.1644 speedup: 2.55
    [rsync 3.2.3 xxh64-zstd] real: 2.81s user: 1.59s sys: 0.73s cpu: 82% maxmem: 6228 KB cswaits: 8799
    
    /usr/local/bin/rsync -avzi --stats --cc xxhash --zc zstd --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxhash-zstd-041220-152607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxhash-zstd] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxhash-zstd] total bytes: 773951797 sent bytes: 303973911 (86865149.43 per second)
    [rsync 3.2.3 xxhash-zstd] transfer speed (MB/s): 97.6067 speedup: 2.55
    [rsync 3.2.3 xxhash-zstd] real: 2.97s user: 1.58s sys: 0.74s cpu: 78% maxmem: 6224 KB cswaits: 8719
    
    /usr/local/bin/rsync -avzi --stats --cc md5 --zc zstd --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-md5-zstd-041220-152607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 md5-zstd] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 md5-zstd] total bytes: 773951797 sent bytes: 303996691 (86871658.00 per second)
    [rsync 3.2.3 md5-zstd] transfer speed (MB/s): 75.6955 speedup: 2.55
    [rsync 3.2.3 md5-zstd] real: 3.83s user: 3.29s sys: 0.76s cpu: 105% maxmem: 6236 KB cswaits: 9081
    

    with zlib
    Code (Text):
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zlib --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zlib-041220-152607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zlib] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zlib] total bytes: 773951797 sent bytes: 774571584 (172139043.56 per second)
    [rsync 3.2.3 xxh128-zlib] transfer speed (MB/s): 177.1436 speedup: 1.00
    [rsync 3.2.3 xxh128-zlib] real: 4.17s user: 2.59s sys: 1.00s cpu: 85% maxmem: 3048 KB cswaits: 20070
    
    /usr/local/bin/rsync -avzi --stats --cc xxh3 --zc zlib --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh3-zlib-041220-152607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh3-zlib] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh3-zlib] total bytes: 773951797 sent bytes: 774548804 (172133981.33 per second)
    [rsync 3.2.3 xxh3-zlib] transfer speed (MB/s): 177.5642 speedup: 1.00
    [rsync 3.2.3 xxh3-zlib] real: 4.16s user: 2.52s sys: 1.03s cpu: 85% maxmem: 3044 KB cswaits: 20129
    
    /usr/local/bin/rsync -avzi --stats --cc xxh64 --zc zlib --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh64-zlib-041220-152607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh64-zlib] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh64-zlib] total bytes: 773951797 sent bytes: 774548804 (172133981.33 per second)
    [rsync 3.2.3 xxh64-zlib] transfer speed (MB/s): 177.5642 speedup: 1.00
    [rsync 3.2.3 xxh64-zlib] real: 4.16s user: 2.54s sys: 0.98s cpu: 85% maxmem: 3032 KB cswaits: 20105
    
    /usr/local/bin/rsync -avzi --stats --cc xxhash --zc zlib --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxhash-zlib-041220-152607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxhash-zlib] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxhash-zlib] total bytes: 773951797 sent bytes: 774548804 (172133981.33 per second)
    [rsync 3.2.3 xxhash-zlib] transfer speed (MB/s): 176.7146 speedup: 1.00
    [rsync 3.2.3 xxhash-zlib] real: 4.18s user: 2.59s sys: 0.98s cpu: 85% maxmem: 3036 KB cswaits: 20162
    
    /usr/local/bin/rsync -avzi --stats --cc md5 --zc zlib --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-md5-zlib-041220-152607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 md5-zlib] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 md5-zlib] total bytes: 773951797 sent bytes: 774571584 (172139043.56 per second)
    [rsync 3.2.3 md5-zlib] transfer speed (MB/s): 153.5736 speedup: 1.00
    [rsync 3.2.3 md5-zlib] real: 4.81s user: 4.22s sys: 0.94s cpu: 107% maxmem: 3044 KB cswaits: 20064
    

    with none
    Code (Text):
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc none --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-none-041220-152607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-none] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-none] total bytes: 773951797 sent bytes: 774437623 (309796694.00 per second)
    [rsync 3.2.3 xxh128-none] transfer speed (MB/s): 311.6292 speedup: 1.00
    [rsync 3.2.3 xxh128-none] real: 2.37s user: 0.26s sys: 0.93s cpu: 50% maxmem: 2744 KB cswaits: 28768
    
    /usr/local/bin/rsync -avzi --stats --cc xxh3 --zc none --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh3-none-041220-152607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh3-none] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh3-none] total bytes: 773951797 sent bytes: 774414847 (309787583.60 per second)
    [rsync 3.2.3 xxh3-none] transfer speed (MB/s): 312.9404 speedup: 1.00
    [rsync 3.2.3 xxh3-none] real: 2.36s user: 0.25s sys: 0.95s cpu: 50% maxmem: 2744 KB cswaits: 28780
    
    /usr/local/bin/rsync -avzi --stats --cc xxh64 --zc none --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh64-none-041220-152607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh64-none] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh64-none] total bytes: 773951797 sent bytes: 774414847 (221276845.43 per second)
    [rsync 3.2.3 xxh64-none] transfer speed (MB/s): 311.6200 speedup: 1.00
    [rsync 3.2.3 xxh64-none] real: 2.37s user: 0.26s sys: 0.96s cpu: 51% maxmem: 2744 KB cswaits: 28625
    
    /usr/local/bin/rsync -avzi --stats --cc xxhash --zc none --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxhash-none-041220-152607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxhash-none] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxhash-none] total bytes: 773951797 sent bytes: 774414847 (309787583.60 per second)
    [rsync 3.2.3 xxhash-none] transfer speed (MB/s): 303.9257 speedup: 1.00
    [rsync 3.2.3 xxhash-none] real: 2.43s user: 0.34s sys: 1.03s cpu: 56% maxmem: 2744 KB cswaits: 27531
    
    /usr/local/bin/rsync -avzi --stats --cc md5 --zc none --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-md5-none-041220-152607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 md5-none] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 md5-none] total bytes: 773951797 sent bytes: 774437623 (221283352.86 per second)
    [rsync 3.2.3 md5-none] transfer speed (MB/s): 243.7495 speedup: 1.00
    [rsync 3.2.3 md5-none] real: 3.03s user: 2.01s sys: 0.93s cpu: 97% maxmem: 2744 KB cswaits: 22452


    rsync-benchmark-051220-table.png

    rsync-benchmark-051220-chart.png

    Summary



    As you can see from the above chart, my custom built Rsync 3.2.3 RPM for CentOS 7 is magnitudes faster than CentOS 7's native Rsync 3.1.2 - especially for compressed file transfers.
    • CentOS 7's Rsync 3.1.2 compressed transfer speed was ~21MB/s while uncompressed was ~244MB/s which is ~22% slower than Rsync 3.2.3's fastest uncompressed speeds.
    • While Rsync 3.2.3 compressed speeds was fastest with zlib compression being up to ~8.47x faster than Rsync 3.1.2
    • Followed closely behind was Rsync 3.2.3 with lz4 at up to ~7.29x faster.
    • Rsync 3.2.3 with zstd compression was actually the slowest and also used the most memory. Though still up to 4.9x faster than Rsync 3.1.2!
     
    Last edited: Dec 5, 2020
  3. eva2000

    eva2000 Administrator Staff Member

    47,294
    10,705
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +16,631
    Local Time:
    9:54 AM
    Nginx 1.19.x
    MariaDB 5.5/10.x

    Compression Level Tests For Rsync



    The developer of Facebook's zstd compression and xxHash hasing algorihtm picked up my results that Rsync 3.2.3 zlib tests don't look right in that bytes sent was much higher as if zlib compression was never done and that transfer might actually be uncompressed. I did some more tests and it might be that Rsync 3.2.3 zlib compression might have such bug and posted my results on Rsync's issue tracker at possible bug with --zc zlib not compressing transferred files? · Issue #123 · WayneD/rsync. Looks like it could be related to rsync 3.2.3's --skip-compress defaults which skip compression a known list of pre-compressed files but the bug is skipping .log extension uncompressed text files even if the .log extension is not in default --skip-compress default list. Waiting on confirmation if it's a bug with Rsync 3.2.3 zlib compression or whether it's some parameter I incorrectly setup on my end.

    Due to this issue, I extended my rsync-benchmark.sh script to do compression level tests similar to my compression tests done at Sysadmin - Round 4: Compression Comparison Benchmarks: zstd vs brotli vs pigz vs bzip2 vs xz etc. So with rsync-benchmark.sh I can specify the compression algorithm, checksum hashing algorithm and a ceiling compression level to do tests from compression levels 1 to the specified ceiling level. For Rsync 3.2.3 and zstd compression it also has negative fast levels of compression to allow for faster compression speeds at the expensive of less compression done (bytes sent would be larger).

    Rsync 3.1.2 Native Compression Levels 1 To 6



    For example, rsync 3.1.2 native with csv format log at `/home/rsync-benchmarks/rsyncbench-rsync-native-compressed-lvls-051220-152618.csv` for compression levels 1 to 6 where time to transfer increases with each high compression level but bytes sent decreases.
    Code (Text):
    ./rsync-benchmark.sh bench-lvl-native 6 /home/rsync-test/ /home/rsync-test-dst/
    /usr/bin/rsync -avzi --stats --compress-level=1 --log-file=/home/rsync-benchmarks/rsyncbench-rsync-native-compressed-lvl1-051220-152618.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.1.2 native compress lvl 1] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.1.2 native compress lvl 1] total bytes: 773951797 sent bytes: 336106979 (26892887.28 per second)
    [rsync 3.1.2 native compress lvl 1] transfer speed (MB/s): 28.9032 speedup: 2.30
    [rsync 3.1.2 native compress lvl 1] real: 11.09s user: 11.05s sys: 0.80s cpu: 106% maxmem: 2328 KB cswaits: 12419
    
    /usr/bin/rsync -avzi --stats --compress-level=2 --log-file=/home/rsync-benchmarks/rsyncbench-rsync-native-compressed-lvl2-051220-152633.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.1.2 native compress lvl 2] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.1.2 native compress lvl 2] total bytes: 773951797 sent bytes: 332848202 (31704982.29 per second)
    [rsync 3.1.2 native compress lvl 2] transfer speed (MB/s): 30.0027 speedup: 2.32
    [rsync 3.1.2 native compress lvl 2] real: 10.58s user: 10.91s sys: 0.78s cpu: 110% maxmem: 2324 KB cswaits: 12388
    
    /usr/bin/rsync -avzi --stats --compress-level=3 --log-file=/home/rsync-benchmarks/rsyncbench-rsync-native-compressed-lvl3-051220-152647.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.1.2 native compress lvl 3] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.1.2 native compress lvl 3] total bytes: 773951797 sent bytes: 330489500 (28742922.78 per second)
    [rsync 3.1.2 native compress lvl 3] transfer speed (MB/s): 29.0755 speedup: 2.34
    [rsync 3.1.2 native compress lvl 3] real: 10.84s user: 11.05s sys: 0.82s cpu: 109% maxmem: 2324 KB cswaits: 12358
    
    /usr/bin/rsync -avzi --stats --compress-level=4 --log-file=/home/rsync-benchmarks/rsyncbench-rsync-native-compressed-lvl4-051220-152701.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.1.2 native compress lvl 4] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.1.2 native compress lvl 4] total bytes: 773951797 sent bytes: 325021461 (26006045.84 per second)
    [rsync 3.1.2 native compress lvl 4] transfer speed (MB/s): 25.7232 speedup: 2.38
    [rsync 3.1.2 native compress lvl 4] real: 12.05s user: 12.36s sys: 0.79s cpu: 109% maxmem: 2328 KB cswaits: 12283
    
    /usr/bin/rsync -avzi --stats --compress-level=5 --log-file=/home/rsync-benchmarks/rsyncbench-rsync-native-compressed-lvl5-051220-152716.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.1.2 native compress lvl 5] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.1.2 native compress lvl 5] total bytes: 773951797 sent bytes: 320904465 (23774709.41 per second)
    [rsync 3.1.2 native compress lvl 5] transfer speed (MB/s): 24.1545 speedup: 2.41
    [rsync 3.1.2 native compress lvl 5] real: 12.67s user: 12.79s sys: 0.84s cpu: 107% maxmem: 2328 KB cswaits: 12227
    
    /usr/bin/rsync -avzi --stats --compress-level=6 --log-file=/home/rsync-benchmarks/rsyncbench-rsync-native-compressed-lvl6-051220-152732.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.1.2 native compress lvl 6] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.1.2 native compress lvl 6] total bytes: 773951797 sent bytes: 319193453 (22017073.45 per second)
    [rsync 3.1.2 native compress lvl 6] transfer speed (MB/s): 21.9946 speedup: 2.42
    [rsync 3.1.2 native compress lvl 6] real: 13.84s user: 14.02s sys: 0.77s cpu: 106% maxmem: 2324 KB cswaits: 12217
    
    csv log: /home/rsync-benchmarks/rsyncbench-rsync-native-compressed-lvls-051220-152618.csv

    Code (Text):
    cat /home/rsync-benchmarks/rsyncbench-rsync-native-compressed-lvls-051220-152618.csv
    version,comp-lvl,speed,time,bytes-sent
    rsync-3.1.2,1,28.9032,11.09,336106979
    rsync-3.1.2,2,30.0027,10.58,332848202
    rsync-3.1.2,3,29.0755,10.84,330489500
    rsync-3.1.2,4,25.7232,12.05,325021461
    rsync-3.1.2,5,24.1545,12.67,320904465
    rsync-3.1.2,6,21.9946,13.84,319193453
    


    Rsync 3.2.3 Zstd Compression Levels -100 To 6



    Rsync zstd has compression levels from -131072 to 22 which allows for greater flexibility in choosing rsync transfer speed versus compression ratio. Rsync zstd default is compression level 3.

    For rsync 3.2.3 xxh128 + zstd. Test for zstd negative level compression for fast compression levels -100 to 6 for rsync 3.2.3 xxh128 + zstd.

    Code (Text):
    ./rsync-benchmark.sh bench-lvl xxh128 zstd 6 /home/rsync-test/ /home/rsync-test-dst/
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -100 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-100-051220-154002.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--100] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--100] total bytes: 773951797 sent bytes: 502524238 (335052233.33 per second)
    [rsync 3.2.3 xxh128-zstd--100] transfer speed (MB/s): 526.6422 speedup: 1.54
    [rsync 3.2.3 xxh128-zstd--100] real: 0.91s user: 0.75s sys: 0.65s cpu: 153% maxmem: 3900 KB cswaits: 6256
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -99 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-99-051220-154007.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--99] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--99] total bytes: 773951797 sent bytes: 502453274 (201002954.40 per second)
    [rsync 3.2.3 xxh128-zstd--99] transfer speed (MB/s): 193.2164 speedup: 1.54
    [rsync 3.2.3 xxh128-zstd--99] real: 2.48s user: 0.77s sys: 0.81s cpu: 64% maxmem: 3900 KB cswaits: 12835
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -98 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-98-051220-154013.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--98] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--98] total bytes: 773951797 sent bytes: 502049349 (200841384.40 per second)
    [rsync 3.2.3 xxh128-zstd--98] transfer speed (MB/s): 194.6307 speedup: 1.54
    [rsync 3.2.3 xxh128-zstd--98] real: 2.46s user: 0.77s sys: 0.80s cpu: 63% maxmem: 3900 KB cswaits: 12828
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -97 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-97-051220-154018.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--97] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--97] total bytes: 773951797 sent bytes: 500879501 (143123889.43 per second)
    [rsync 3.2.3 xxh128-zstd--97] transfer speed (MB/s): 182.3190 speedup: 1.55
    [rsync 3.2.3 xxh128-zstd--97] real: 2.62s user: 0.97s sys: 0.92s cpu: 72% maxmem: 3900 KB cswaits: 12720
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -96 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-96-051220-154024.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--96] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--96] total bytes: 773951797 sent bytes: 499563263 (142747821.43 per second)
    [rsync 3.2.3 xxh128-zstd--96] transfer speed (MB/s): 192.1051 speedup: 1.55
    [rsync 3.2.3 xxh128-zstd--96] real: 2.48s user: 0.75s sys: 0.82s cpu: 63% maxmem: 3900 KB cswaits: 12780
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -95 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-95-051220-154030.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--95] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--95] total bytes: 773951797 sent bytes: 498153689 (199283120.40 per second)
    [rsync 3.2.3 xxh128-zstd--95] transfer speed (MB/s): 193.1204 speedup: 1.55
    [rsync 3.2.3 xxh128-zstd--95] real: 2.46s user: 0.75s sys: 0.82s cpu: 64% maxmem: 3896 KB cswaits: 12693
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -94 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-94-051220-154036.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--94] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--94] total bytes: 773951797 sent bytes: 496505085 (198623678.80 per second)
    [rsync 3.2.3 xxh128-zstd--94] transfer speed (MB/s): 191.7020 speedup: 1.56
    [rsync 3.2.3 xxh128-zstd--94] real: 2.47s user: 0.75s sys: 0.83s cpu: 64% maxmem: 3900 KB cswaits: 12839
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -93 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-93-051220-154042.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--93] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--93] total bytes: 773951797 sent bytes: 495571690 (198250320.80 per second)
    [rsync 3.2.3 xxh128-zstd--93] transfer speed (MB/s): 186.8039 speedup: 1.56
    [rsync 3.2.3 xxh128-zstd--93] real: 2.53s user: 0.85s sys: 0.89s cpu: 68% maxmem: 3900 KB cswaits: 12381
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -92 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-92-051220-154047.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--92] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--92] total bytes: 773951797 sent bytes: 494365618 (141262780.00 per second)
    [rsync 3.2.3 xxh128-zstd--92] transfer speed (MB/s): 202.3449 speedup: 1.57
    [rsync 3.2.3 xxh128-zstd--92] real: 2.33s user: 0.80s sys: 0.80s cpu: 68% maxmem: 3900 KB cswaits: 12675
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -91 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-91-051220-154053.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--91] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--91] total bytes: 773951797 sent bytes: 493480440 (141009872.00 per second)
    [rsync 3.2.3 xxh128-zstd--91] transfer speed (MB/s): 187.4978 speedup: 1.57
    [rsync 3.2.3 xxh128-zstd--91] real: 2.51s user: 0.77s sys: 0.86s cpu: 65% maxmem: 3900 KB cswaits: 12668
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -90 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-90-051220-154059.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--90] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--90] total bytes: 773951797 sent bytes: 491820410 (196749808.80 per second)
    [rsync 3.2.3 xxh128-zstd--90] transfer speed (MB/s): 189.8933 speedup: 1.57
    [rsync 3.2.3 xxh128-zstd--90] real: 2.47s user: 0.77s sys: 0.81s cpu: 64% maxmem: 3900 KB cswaits: 12653
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -89 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-89-051220-154105.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--89] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--89] total bytes: 773951797 sent bytes: 490183797 (196095163.60 per second)
    [rsync 3.2.3 xxh128-zstd--89] transfer speed (MB/s): 188.4982 speedup: 1.58
    [rsync 3.2.3 xxh128-zstd--89] real: 2.48s user: 0.78s sys: 0.81s cpu: 64% maxmem: 3900 KB cswaits: 12623
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -88 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-88-051220-154110.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--88] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--88] total bytes: 773951797 sent bytes: 489277129 (139808926.00 per second)
    [rsync 3.2.3 xxh128-zstd--88] transfer speed (MB/s): 176.0796 speedup: 1.58
    [rsync 3.2.3 xxh128-zstd--88] real: 2.65s user: 0.98s sys: 1.01s cpu: 75% maxmem: 3900 KB cswaits: 12298
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -87 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-87-051220-154116.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--87] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--87] total bytes: 773951797 sent bytes: 487990191 (139441229.43 per second)
    [rsync 3.2.3 xxh128-zstd--87] transfer speed (MB/s): 189.1803 speedup: 1.59
    [rsync 3.2.3 xxh128-zstd--87] real: 2.46s user: 0.82s sys: 0.77s cpu: 64% maxmem: 3900 KB cswaits: 12529
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -86 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-86-051220-154122.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--86] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--86] total bytes: 773951797 sent bytes: 487197617 (139214779.71 per second)
    [rsync 3.2.3 xxh128-zstd--86] transfer speed (MB/s): 188.1084 speedup: 1.59
    [rsync 3.2.3 xxh128-zstd--86] real: 2.47s user: 0.78s sys: 0.81s cpu: 64% maxmem: 3900 KB cswaits: 12531
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -85 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-85-051220-154128.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--85] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--85] total bytes: 773951797 sent bytes: 486122201 (194470525.20 per second)
    [rsync 3.2.3 xxh128-zstd--85] transfer speed (MB/s): 183.2419 speedup: 1.59
    [rsync 3.2.3 xxh128-zstd--85] real: 2.53s user: 0.84s sys: 0.82s cpu: 65% maxmem: 3900 KB cswaits: 12562
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -84 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-84-051220-154134.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--84] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--84] total bytes: 773951797 sent bytes: 484780234 (193933738.40 per second)
    [rsync 3.2.3 xxh128-zstd--84] transfer speed (MB/s): 200.1395 speedup: 1.60
    [rsync 3.2.3 xxh128-zstd--84] real: 2.31s user: 0.81s sys: 0.79s cpu: 69% maxmem: 3900 KB cswaits: 12514
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -83 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-83-051220-154139.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--83] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--83] total bytes: 773951797 sent bytes: 483478631 (138152212.29 per second)
    [rsync 3.2.3 xxh128-zstd--83] transfer speed (MB/s): 180.1098 speedup: 1.60
    [rsync 3.2.3 xxh128-zstd--83] real: 2.56s user: 0.92s sys: 0.87s cpu: 70% maxmem: 3900 KB cswaits: 12440
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -82 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-82-051220-154145.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--82] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--82] total bytes: 773951797 sent bytes: 482495260 (137871249.14 per second)
    [rsync 3.2.3 xxh128-zstd--82] transfer speed (MB/s): 177.6615 speedup: 1.60
    [rsync 3.2.3 xxh128-zstd--82] real: 2.59s user: 0.96s sys: 0.95s cpu: 73% maxmem: 3900 KB cswaits: 12392
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -81 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-81-051220-154151.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--81] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--81] total bytes: 773951797 sent bytes: 481526759 (137594534.57 per second)
    [rsync 3.2.3 xxh128-zstd--81] transfer speed (MB/s): 184.4255 speedup: 1.61
    [rsync 3.2.3 xxh128-zstd--81] real: 2.49s user: 0.78s sys: 0.82s cpu: 64% maxmem: 3900 KB cswaits: 12446
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -80 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-80-051220-154157.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--80] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--80] total bytes: 773951797 sent bytes: 480159728 (192085536.00 per second)
    [rsync 3.2.3 xxh128-zstd--80] transfer speed (MB/s): 183.1664 speedup: 1.61
    [rsync 3.2.3 xxh128-zstd--80] real: 2.50s user: 0.82s sys: 0.79s cpu: 64% maxmem: 3900 KB cswaits: 12445
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -79 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-79-051220-154203.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--79] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--79] total bytes: 773951797 sent bytes: 478753157 (191522907.60 per second)
    [rsync 3.2.3 xxh128-zstd--79] transfer speed (MB/s): 184.1026 speedup: 1.62
    [rsync 3.2.3 xxh128-zstd--79] real: 2.48s user: 0.83s sys: 0.77s cpu: 64% maxmem: 3900 KB cswaits: 12400
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -78 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-78-051220-154209.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--78] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--78] total bytes: 773951797 sent bytes: 477288999 (190937244.40 per second)
    [rsync 3.2.3 xxh128-zstd--78] transfer speed (MB/s): 181.3459 speedup: 1.62
    [rsync 3.2.3 xxh128-zstd--78] real: 2.51s user: 0.79s sys: 0.83s cpu: 64% maxmem: 3900 KB cswaits: 12349
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -77 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-77-051220-154214.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--77] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--77] total bytes: 773951797 sent bytes: 476899601 (136272489.43 per second)
    [rsync 3.2.3 xxh128-zstd--77] transfer speed (MB/s): 178.3556 speedup: 1.62
    [rsync 3.2.3 xxh128-zstd--77] real: 2.55s user: 0.84s sys: 0.85s cpu: 66% maxmem: 3900 KB cswaits: 12267
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -76 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-76-051220-154220.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--76] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--76] total bytes: 773951797 sent bytes: 476205412 (190503809.60 per second)
    [rsync 3.2.3 xxh128-zstd--76] transfer speed (MB/s): 195.7520 speedup: 1.63
    [rsync 3.2.3 xxh128-zstd--76] real: 2.32s user: 0.78s sys: 0.83s cpu: 69% maxmem: 3900 KB cswaits: 12374
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -75 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-75-051220-154226.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--75] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--75] total bytes: 773951797 sent bytes: 476060832 (190445977.60 per second)
    [rsync 3.2.3 xxh128-zstd--75] transfer speed (MB/s): 183.0673 speedup: 1.63
    [rsync 3.2.3 xxh128-zstd--75] real: 2.48s user: 0.85s sys: 0.76s cpu: 65% maxmem: 3896 KB cswaits: 12464
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -74 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-74-051220-154232.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--74] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--74] total bytes: 773951797 sent bytes: 475791488 (190338240.00 per second)
    [rsync 3.2.3 xxh128-zstd--74] transfer speed (MB/s): 194.7425 speedup: 1.63
    [rsync 3.2.3 xxh128-zstd--74] real: 2.33s user: 0.84s sys: 0.78s cpu: 69% maxmem: 3900 KB cswaits: 12382
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -73 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-73-051220-154237.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--73] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--73] total bytes: 773951797 sent bytes: 476605516 (136188465.14 per second)
    [rsync 3.2.3 xxh128-zstd--73] transfer speed (MB/s): 181.0862 speedup: 1.62
    [rsync 3.2.3 xxh128-zstd--73] real: 2.51s user: 0.88s sys: 0.83s cpu: 68% maxmem: 3900 KB cswaits: 12393
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -72 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-72-051220-154243.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--72] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--72] total bytes: 773951797 sent bytes: 478019952 (136592589.71 per second)
    [rsync 3.2.3 xxh128-zstd--72] transfer speed (MB/s): 172.6800 speedup: 1.62
    [rsync 3.2.3 xxh128-zstd--72] real: 2.64s user: 1.05s sys: 0.94s cpu: 75% maxmem: 3900 KB cswaits: 12301
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -71 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-71-051220-154249.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--71] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--71] total bytes: 773951797 sent bytes: 478758547 (136803616.86 per second)
    [rsync 3.2.3 xxh128-zstd--71] transfer speed (MB/s): 180.4662 speedup: 1.62
    [rsync 3.2.3 xxh128-zstd--71] real: 2.53s user: 0.80s sys: 0.83s cpu: 64% maxmem: 3900 KB cswaits: 12401
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -70 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-70-051220-154255.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--70] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--70] total bytes: 773951797 sent bytes: 476731459 (190714228.40 per second)
    [rsync 3.2.3 xxh128-zstd--70] transfer speed (MB/s): 183.3252 speedup: 1.62
    [rsync 3.2.3 xxh128-zstd--70] real: 2.48s user: 0.82s sys: 0.79s cpu: 65% maxmem: 3900 KB cswaits: 12448
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -69 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-69-051220-154301.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--69] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--69] total bytes: 773951797 sent bytes: 473662800 (189486764.80 per second)
    [rsync 3.2.3 xxh128-zstd--69] transfer speed (MB/s): 180.6880 speedup: 1.63
    [rsync 3.2.3 xxh128-zstd--69] real: 2.50s user: 0.85s sys: 0.77s cpu: 65% maxmem: 3900 KB cswaits: 12382
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -68 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-68-051220-154306.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--68] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--68] total bytes: 773951797 sent bytes: 470345777 (134399968.29 per second)
    [rsync 3.2.3 xxh128-zstd--68] transfer speed (MB/s): 177.9986 speedup: 1.65
    [rsync 3.2.3 xxh128-zstd--68] real: 2.52s user: 0.91s sys: 0.77s cpu: 67% maxmem: 3896 KB cswaits: 12324
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -67 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-67-051220-154312.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--67] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--67] total bytes: 773951797 sent bytes: 467061682 (133461655.43 per second)
    [rsync 3.2.3 xxh128-zstd--67] transfer speed (MB/s): 176.7558 speedup: 1.66
    [rsync 3.2.3 xxh128-zstd--67] real: 2.52s user: 0.89s sys: 0.79s cpu: 66% maxmem: 3900 KB cswaits: 12319
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -66 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-66-051220-154318.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--66] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--66] total bytes: 773951797 sent bytes: 464067371 (185648593.20 per second)
    [rsync 3.2.3 xxh128-zstd--66] transfer speed (MB/s): 186.7380 speedup: 1.67
    [rsync 3.2.3 xxh128-zstd--66] real: 2.37s user: 0.88s sys: 0.75s cpu: 69% maxmem: 3904 KB cswaits: 12307
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -65 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-65-051220-154324.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--65] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--65] total bytes: 773951797 sent bytes: 462563095 (185046882.80 per second)
    [rsync 3.2.3 xxh128-zstd--65] transfer speed (MB/s): 172.3181 speedup: 1.67
    [rsync 3.2.3 xxh128-zstd--65] real: 2.56s user: 0.92s sys: 0.86s cpu: 69% maxmem: 3900 KB cswaits: 12232
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -64 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-64-051220-154330.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--64] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--64] total bytes: 773951797 sent bytes: 461370332 (184569777.60 per second)
    [rsync 3.2.3 xxh128-zstd--64] transfer speed (MB/s): 174.6019 speedup: 1.68
    [rsync 3.2.3 xxh128-zstd--64] real: 2.52s user: 0.79s sys: 0.85s cpu: 65% maxmem: 3904 KB cswaits: 12261
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -63 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-63-051220-154335.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--63] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--63] total bytes: 773951797 sent bytes: 459643528 (131342182.86 per second)
    [rsync 3.2.3 xxh128-zstd--63] transfer speed (MB/s): 168.5962 speedup: 1.68
    [rsync 3.2.3 xxh128-zstd--63] real: 2.60s user: 1.01s sys: 0.84s cpu: 71% maxmem: 3904 KB cswaits: 12287
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -62 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-62-051220-154341.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--62] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--62] total bytes: 773951797 sent bytes: 458579559 (131038191.71 per second)
    [rsync 3.2.3 xxh128-zstd--62] transfer speed (MB/s): 175.6367 speedup: 1.69
    [rsync 3.2.3 xxh128-zstd--62] real: 2.49s user: 0.86s sys: 0.78s cpu: 66% maxmem: 3904 KB cswaits: 12288
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -61 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-61-051220-154347.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--61] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--61] total bytes: 773951797 sent bytes: 457537488 (130740457.14 per second)
    [rsync 3.2.3 xxh128-zstd--61] transfer speed (MB/s): 172.4670 speedup: 1.69
    [rsync 3.2.3 xxh128-zstd--61] real: 2.53s user: 0.85s sys: 0.79s cpu: 65% maxmem: 3904 KB cswaits: 12302
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -60 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-60-051220-154353.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--60] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--60] total bytes: 773951797 sent bytes: 456119111 (130335206.57 per second)
    [rsync 3.2.3 xxh128-zstd--60] transfer speed (MB/s): 162.9172 speedup: 1.70
    [rsync 3.2.3 xxh128-zstd--60] real: 2.67s user: 1.10s sys: 0.97s cpu: 77% maxmem: 3924 KB cswaits: 11945
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -59 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-59-051220-154359.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--59] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--59] total bytes: 773951797 sent bytes: 454375186 (181771719.20 per second)
    [rsync 3.2.3 xxh128-zstd--59] transfer speed (MB/s): 173.3303 speedup: 1.70
    [rsync 3.2.3 xxh128-zstd--59] real: 2.50s user: 0.85s sys: 0.79s cpu: 65% maxmem: 3904 KB cswaits: 12244
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -58 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-58-051220-154405.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--58] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--58] total bytes: 773951797 sent bytes: 451871677 (180770315.60 per second)
    [rsync 3.2.3 xxh128-zstd--58] transfer speed (MB/s): 182.6010 speedup: 1.71
    [rsync 3.2.3 xxh128-zstd--58] real: 2.36s user: 0.86s sys: 0.79s cpu: 70% maxmem: 3904 KB cswaits: 12262
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -57 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-57-051220-154410.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--57] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--57] total bytes: 773951797 sent bytes: 449243392 (128370715.43 per second)
    [rsync 3.2.3 xxh128-zstd--57] transfer speed (MB/s): 161.6724 speedup: 1.72
    [rsync 3.2.3 xxh128-zstd--57] real: 2.65s user: 1.05s sys: 0.89s cpu: 73% maxmem: 3904 KB cswaits: 12119
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -56 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-56-051220-154416.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--56] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--56] total bytes: 773951797 sent bytes: 446974550 (127722474.86 per second)
    [rsync 3.2.3 xxh128-zstd--56] transfer speed (MB/s): 169.8279 speedup: 1.73
    [rsync 3.2.3 xxh128-zstd--56] real: 2.51s user: 0.87s sys: 0.79s cpu: 66% maxmem: 3904 KB cswaits: 12250
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -55 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-55-051220-154422.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--55] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--55] total bytes: 773951797 sent bytes: 444949319 (127143837.43 per second)
    [rsync 3.2.3 xxh128-zstd--55] transfer speed (MB/s): 169.0584 speedup: 1.74
    [rsync 3.2.3 xxh128-zstd--55] real: 2.51s user: 0.84s sys: 0.82s cpu: 66% maxmem: 3900 KB cswaits: 12201
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -54 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-54-051220-154428.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--54] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--54] total bytes: 773951797 sent bytes: 443448644 (126715073.14 per second)
    [rsync 3.2.3 xxh128-zstd--54] transfer speed (MB/s): 165.1974 speedup: 1.75
    [rsync 3.2.3 xxh128-zstd--54] real: 2.56s user: 0.92s sys: 0.83s cpu: 68% maxmem: 3904 KB cswaits: 12206
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -53 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-53-051220-154434.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--53] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--53] total bytes: 773951797 sent bytes: 441267106 (176528487.20 per second)
    [rsync 3.2.3 xxh128-zstd--53] transfer speed (MB/s): 167.6594 speedup: 1.75
    [rsync 3.2.3 xxh128-zstd--53] real: 2.51s user: 0.88s sys: 0.78s cpu: 66% maxmem: 3904 KB cswaits: 12257
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -52 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-52-051220-154440.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--52] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--52] total bytes: 773951797 sent bytes: 438392569 (175378672.40 per second)
    [rsync 3.2.3 xxh128-zstd--52] transfer speed (MB/s): 167.2334 speedup: 1.77
    [rsync 3.2.3 xxh128-zstd--52] real: 2.50s user: 0.86s sys: 0.81s cpu: 67% maxmem: 3904 KB cswaits: 12149
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -51 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-51-051220-154446.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--51] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--51] total bytes: 773951797 sent bytes: 435415113 (174187690.00 per second)
    [rsync 3.2.3 xxh128-zstd--51] transfer speed (MB/s): 164.1281 speedup: 1.78
    [rsync 3.2.3 xxh128-zstd--51] real: 2.53s user: 0.91s sys: 0.77s cpu: 66% maxmem: 3900 KB cswaits: 12203
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -50 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-50-051220-154451.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--50] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--50] total bytes: 773951797 sent bytes: 433707259 (123931820.29 per second)
    [rsync 3.2.3 xxh128-zstd--50] transfer speed (MB/s): 174.5212 speedup: 1.78
    [rsync 3.2.3 xxh128-zstd--50] real: 2.37s user: 0.91s sys: 0.78s cpu: 71% maxmem: 3904 KB cswaits: 12136
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -49 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-49-051220-154457.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--49] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--49] total bytes: 773951797 sent bytes: 432339753 (123541104.29 per second)
    [rsync 3.2.3 xxh128-zstd--49] transfer speed (MB/s): 161.6907 speedup: 1.79
    [rsync 3.2.3 xxh128-zstd--49] real: 2.55s user: 0.87s sys: 0.82s cpu: 66% maxmem: 3908 KB cswaits: 12185
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -48 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-48-051220-154503.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--48] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--48] total bytes: 773951797 sent bytes: 430679674 (172293514.40 per second)
    [rsync 3.2.3 xxh128-zstd--48] transfer speed (MB/s): 162.3431 speedup: 1.80
    [rsync 3.2.3 xxh128-zstd--48] real: 2.53s user: 0.91s sys: 0.77s cpu: 66% maxmem: 3900 KB cswaits: 12231
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -47 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-47-051220-154509.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--47] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--47] total bytes: 773951797 sent bytes: 429355974 (171764034.40 per second)
    [rsync 3.2.3 xxh128-zstd--47] transfer speed (MB/s): 161.2069 speedup: 1.80
    [rsync 3.2.3 xxh128-zstd--47] real: 2.54s user: 0.88s sys: 0.81s cpu: 66% maxmem: 3904 KB cswaits: 12267
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -46 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-46-051220-154515.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--46] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--46] total bytes: 773951797 sent bytes: 427932036 (171194459.20 per second)
    [rsync 3.2.3 xxh128-zstd--46] transfer speed (MB/s): 159.4171 speedup: 1.81
    [rsync 3.2.3 xxh128-zstd--46] real: 2.56s user: 0.90s sys: 0.79s cpu: 66% maxmem: 3904 KB cswaits: 12299
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -45 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-45-051220-154521.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--45] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--45] total bytes: 773951797 sent bytes: 425884343 (170375382.00 per second)
    [rsync 3.2.3 xxh128-zstd--45] transfer speed (MB/s): 151.5503 speedup: 1.82
    [rsync 3.2.3 xxh128-zstd--45] real: 2.68s user: 1.10s sys: 0.86s cpu: 73% maxmem: 3904 KB cswaits: 12268
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -44 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-44-051220-154526.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--44] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--44] total bytes: 773951797 sent bytes: 422770844 (120807130.29 per second)
    [rsync 3.2.3 xxh128-zstd--44] transfer speed (MB/s): 159.9943 speedup: 1.83
    [rsync 3.2.3 xxh128-zstd--44] real: 2.52s user: 0.88s sys: 0.82s cpu: 67% maxmem: 3900 KB cswaits: 12304
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -43 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-43-051220-154532.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--43] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--43] total bytes: 773951797 sent bytes: 419605077 (119902625.43 per second)
    [rsync 3.2.3 xxh128-zstd--43] transfer speed (MB/s): 155.7068 speedup: 1.84
    [rsync 3.2.3 xxh128-zstd--43] real: 2.57s user: 0.92s sys: 0.81s cpu: 67% maxmem: 3904 KB cswaits: 12342
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -42 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-42-051220-154538.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--42] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--42] total bytes: 773951797 sent bytes: 416224609 (118936777.43 per second)
    [rsync 3.2.3 xxh128-zstd--42] transfer speed (MB/s): 166.7826 speedup: 1.86
    [rsync 3.2.3 xxh128-zstd--42] real: 2.38s user: 0.89s sys: 0.81s cpu: 71% maxmem: 3908 KB cswaits: 12289
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -41 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-41-051220-154544.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--41] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--41] total bytes: 773951797 sent bytes: 413186825 (165296374.80 per second)
    [rsync 3.2.3 xxh128-zstd--41] transfer speed (MB/s): 154.5277 speedup: 1.87
    [rsync 3.2.3 xxh128-zstd--41] real: 2.55s user: 0.93s sys: 0.78s cpu: 67% maxmem: 3908 KB cswaits: 12255
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -40 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-40-051220-154550.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--40] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--40] total bytes: 773951797 sent bytes: 411245457 (164519827.60 per second)
    [rsync 3.2.3 xxh128-zstd--40] transfer speed (MB/s): 154.4071 speedup: 1.88
    [rsync 3.2.3 xxh128-zstd--40] real: 2.54s user: 0.92s sys: 0.78s cpu: 67% maxmem: 3908 KB cswaits: 12353
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -39 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-39-051220-154556.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--39] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--39] total bytes: 773951797 sent bytes: 408902519 (163582652.40 per second)
    [rsync 3.2.3 xxh128-zstd--39] transfer speed (MB/s): 152.3280 speedup: 1.89
    [rsync 3.2.3 xxh128-zstd--39] real: 2.56s user: 0.93s sys: 0.78s cpu: 67% maxmem: 3908 KB cswaits: 12237
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -38 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-38-051220-154601.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--38] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--38] total bytes: 773951797 sent bytes: 406763185 (116233513.43 per second)
    [rsync 3.2.3 xxh128-zstd--38] transfer speed (MB/s): 152.1253 speedup: 1.90
    [rsync 3.2.3 xxh128-zstd--38] real: 2.55s user: 0.97s sys: 0.75s cpu: 67% maxmem: 3920 KB cswaits: 12222
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -37 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-37-051220-154607.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--37] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--37] total bytes: 773951797 sent bytes: 404712276 (115647539.43 per second)
    [rsync 3.2.3 xxh128-zstd--37] transfer speed (MB/s): 150.7670 speedup: 1.91
    [rsync 3.2.3 xxh128-zstd--37] real: 2.56s user: 0.92s sys: 0.81s cpu: 67% maxmem: 3920 KB cswaits: 12238
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -36 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-36-051220-154613.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--36] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--36] total bytes: 773951797 sent bytes: 402538714 (115026521.71 per second)
    [rsync 3.2.3 xxh128-zstd--36] transfer speed (MB/s): 142.1817 speedup: 1.92
    [rsync 3.2.3 xxh128-zstd--36] real: 2.70s user: 1.16s sys: 0.91s cpu: 76% maxmem: 3920 KB cswaits: 12141
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -35 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-35-051220-154619.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--35] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--35] total bytes: 773951797 sent bytes: 400521259 (114450106.00 per second)
    [rsync 3.2.3 xxh128-zstd--35] transfer speed (MB/s): 148.0491 speedup: 1.93
    [rsync 3.2.3 xxh128-zstd--35] real: 2.58s user: 0.95s sys: 0.78s cpu: 67% maxmem: 3920 KB cswaits: 12170
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -34 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-34-051220-154625.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--34] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--34] total bytes: 773951797 sent bytes: 397739780 (159117556.80 per second)
    [rsync 3.2.3 xxh128-zstd--34] transfer speed (MB/s): 158.7088 speedup: 1.95
    [rsync 3.2.3 xxh128-zstd--34] real: 2.39s user: 0.96s sys: 0.76s cpu: 72% maxmem: 3924 KB cswaits: 12230
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -33 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-33-051220-154631.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--33] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--33] total bytes: 773951797 sent bytes: 394291346 (157738183.20 per second)
    [rsync 3.2.3 xxh128-zstd--33] transfer speed (MB/s): 145.7463 speedup: 1.96
    [rsync 3.2.3 xxh128-zstd--33] real: 2.58s user: 1.03s sys: 0.74s cpu: 68% maxmem: 3924 KB cswaits: 12176
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -32 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-32-051220-154637.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--32] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--32] total bytes: 773951797 sent bytes: 390575206 (156251727.20 per second)
    [rsync 3.2.3 xxh128-zstd--32] transfer speed (MB/s): 144.9344 speedup: 1.98
    [rsync 3.2.3 xxh128-zstd--32] real: 2.57s user: 0.94s sys: 0.79s cpu: 67% maxmem: 3924 KB cswaits: 12136
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -31 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-31-051220-154643.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--31] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--31] total bytes: 773951797 sent bytes: 388336938 (155356420.00 per second)
    [rsync 3.2.3 xxh128-zstd--31] transfer speed (MB/s): 138.7067 speedup: 1.99
    [rsync 3.2.3 xxh128-zstd--31] real: 2.67s user: 1.10s sys: 0.85s cpu: 73% maxmem: 3924 KB cswaits: 12040
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -30 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-30-051220-154649.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--30] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--30] total bytes: 773951797 sent bytes: 386620494 (154669842.40 per second)
    [rsync 3.2.3 xxh128-zstd--30] transfer speed (MB/s): 142.9108 speedup: 2.00
    [rsync 3.2.3 xxh128-zstd--30] real: 2.58s user: 0.98s sys: 0.77s cpu: 67% maxmem: 3924 KB cswaits: 12032
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -29 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-29-051220-154654.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--29] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--29] total bytes: 773951797 sent bytes: 384413549 (109847903.14 per second)
    [rsync 3.2.3 xxh128-zstd--29] transfer speed (MB/s): 143.7667 speedup: 2.01
    [rsync 3.2.3 xxh128-zstd--29] real: 2.55s user: 0.97s sys: 0.77s cpu: 68% maxmem: 3924 KB cswaits: 12014
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -28 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-28-051220-154700.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--28] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--28] total bytes: 773951797 sent bytes: 382051851 (109173132.29 per second)
    [rsync 3.2.3 xxh128-zstd--28] transfer speed (MB/s): 140.6768 speedup: 2.03
    [rsync 3.2.3 xxh128-zstd--28] real: 2.59s user: 0.98s sys: 0.76s cpu: 67% maxmem: 3924 KB cswaits: 12000
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -27 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-27-051220-154706.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--27] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--27] total bytes: 773951797 sent bytes: 379451361 (108430135.14 per second)
    [rsync 3.2.3 xxh128-zstd--27] transfer speed (MB/s): 139.7193 speedup: 2.04
    [rsync 3.2.3 xxh128-zstd--27] real: 2.59s user: 0.99s sys: 0.76s cpu: 67% maxmem: 3924 KB cswaits: 11919
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -26 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-26-051220-154712.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--26] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--26] total bytes: 773951797 sent bytes: 376666143 (150688102.00 per second)
    [rsync 3.2.3 xxh128-zstd--26] transfer speed (MB/s): 146.0231 speedup: 2.05
    [rsync 3.2.3 xxh128-zstd--26] real: 2.46s user: 1.02s sys: 0.81s cpu: 75% maxmem: 3920 KB cswaits: 11841
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -25 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-25-051220-154718.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--25] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--25] total bytes: 773951797 sent bytes: 374351489 (149762240.40 per second)
    [rsync 3.2.3 xxh128-zstd--25] transfer speed (MB/s): 133.7113 speedup: 2.07
    [rsync 3.2.3 xxh128-zstd--25] real: 2.67s user: 1.12s sys: 0.85s cpu: 74% maxmem: 3924 KB cswaits: 11851
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -24 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-24-051220-154724.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--24] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--24] total bytes: 773951797 sent bytes: 372285599 (148935884.40 per second)
    [rsync 3.2.3 xxh128-zstd--24] transfer speed (MB/s): 137.6120 speedup: 2.08
    [rsync 3.2.3 xxh128-zstd--24] real: 2.58s user: 0.98s sys: 0.78s cpu: 68% maxmem: 3924 KB cswaits: 11786
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -23 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-23-051220-154730.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--23] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--23] total bytes: 773951797 sent bytes: 370465323 (148207774.00 per second)
    [rsync 3.2.3 xxh128-zstd--23] transfer speed (MB/s): 135.3652 speedup: 2.09
    [rsync 3.2.3 xxh128-zstd--23] real: 2.61s user: 1.00s sys: 0.78s cpu: 68% maxmem: 3928 KB cswaits: 11782
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -22 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-22-051220-154736.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--22] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--22] total bytes: 773951797 sent bytes: 368468575 (147409074.80 per second)
    [rsync 3.2.3 xxh128-zstd--22] transfer speed (MB/s): 135.6752 speedup: 2.10
    [rsync 3.2.3 xxh128-zstd--22] real: 2.59s user: 1.02s sys: 0.75s cpu: 68% maxmem: 3928 KB cswaits: 11721
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -21 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-21-051220-154741.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--21] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--21] total bytes: 773951797 sent bytes: 366791851 (104813132.29 per second)
    [rsync 3.2.3 xxh128-zstd--21] transfer speed (MB/s): 128.1318 speedup: 2.11
    [rsync 3.2.3 xxh128-zstd--21] real: 2.73s user: 1.23s sys: 0.87s cpu: 76% maxmem: 3928 KB cswaits: 11637
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -20 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-20-051220-154748.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--20] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--20] total bytes: 773951797 sent bytes: 365387281 (146176557.20 per second)
    [rsync 3.2.3 xxh128-zstd--20] transfer speed (MB/s): 133.5097 speedup: 2.12
    [rsync 3.2.3 xxh128-zstd--20] real: 2.61s user: 1.03s sys: 0.76s cpu: 68% maxmem: 3928 KB cswaits: 11623
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -19 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-19-051220-154753.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--19] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--19] total bytes: 773951797 sent bytes: 364009669 (104018223.14 per second)
    [rsync 3.2.3 xxh128-zstd--19] transfer speed (MB/s): 130.0174 speedup: 2.13
    [rsync 3.2.3 xxh128-zstd--19] real: 2.67s user: 1.13s sys: 0.79s cpu: 72% maxmem: 3928 KB cswaits: 11695
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -18 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-18-051220-154759.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--18] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--18] total bytes: 773951797 sent bytes: 362301545 (103530187.71 per second)
    [rsync 3.2.3 xxh128-zstd--18] transfer speed (MB/s): 134.9678 speedup: 2.14
    [rsync 3.2.3 xxh128-zstd--18] real: 2.56s user: 1.19s sys: 0.85s cpu: 80% maxmem: 3928 KB cswaits: 11559
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -17 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-17-051220-154805.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--17] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--17] total bytes: 773951797 sent bytes: 360364658 (102976791.43 per second)
    [rsync 3.2.3 xxh128-zstd--17] transfer speed (MB/s): 129.6869 speedup: 2.15
    [rsync 3.2.3 xxh128-zstd--17] real: 2.65s user: 1.10s sys: 0.82s cpu: 72% maxmem: 3928 KB cswaits: 11525
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -16 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-16-051220-154811.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--16] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--16] total bytes: 773951797 sent bytes: 357973074 (102293481.71 per second)
    [rsync 3.2.3 xxh128-zstd--16] transfer speed (MB/s): 128.8263 speedup: 2.16
    [rsync 3.2.3 xxh128-zstd--16] real: 2.65s user: 1.08s sys: 0.80s cpu: 71% maxmem: 3928 KB cswaits: 11369
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -15 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-15-051220-154817.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--15] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--15] total bytes: 773951797 sent bytes: 355878668 (101695080.00 per second)
    [rsync 3.2.3 xxh128-zstd--15] transfer speed (MB/s): 130.0353 speedup: 2.17
    [rsync 3.2.3 xxh128-zstd--15] real: 2.61s user: 1.05s sys: 0.75s cpu: 69% maxmem: 3928 KB cswaits: 11494
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -14 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-14-051220-154823.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--14] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--14] total bytes: 773951797 sent bytes: 353352063 (100973192.86 per second)
    [rsync 3.2.3 xxh128-zstd--14] transfer speed (MB/s): 128.6193 speedup: 2.19
    [rsync 3.2.3 xxh128-zstd--14] real: 2.62s user: 1.04s sys: 0.77s cpu: 69% maxmem: 3928 KB cswaits: 11436
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -13 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-13-051220-154829.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--13] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--13] total bytes: 773951797 sent bytes: 350327835 (100109127.71 per second)
    [rsync 3.2.3 xxh128-zstd--13] transfer speed (MB/s): 126.5525 speedup: 2.21
    [rsync 3.2.3 xxh128-zstd--13] real: 2.64s user: 1.10s sys: 0.71s cpu: 68% maxmem: 3928 KB cswaits: 11324
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -12 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-12-051220-154835.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--12] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--12] total bytes: 773951797 sent bytes: 347623477 (99336454.00 per second)
    [rsync 3.2.3 xxh128-zstd--12] transfer speed (MB/s): 126.5341 speedup: 2.23
    [rsync 3.2.3 xxh128-zstd--12] real: 2.62s user: 1.02s sys: 0.79s cpu: 69% maxmem: 3924 KB cswaits: 11320
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -11 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-11-051220-154841.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--11] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--11] total bytes: 773951797 sent bytes: 345086348 (98611560.00 per second)
    [rsync 3.2.3 xxh128-zstd--11] transfer speed (MB/s): 126.0919 speedup: 2.24
    [rsync 3.2.3 xxh128-zstd--11] real: 2.61s user: 1.06s sys: 0.75s cpu: 69% maxmem: 3928 KB cswaits: 11270
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -10 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-10-051220-154847.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--10] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--10] total bytes: 773951797 sent bytes: 342864256 (137167347.20 per second)
    [rsync 3.2.3 xxh128-zstd--10] transfer speed (MB/s): 132.3809 speedup: 2.26
    [rsync 3.2.3 xxh128-zstd--10] real: 2.47s user: 1.03s sys: 0.78s cpu: 73% maxmem: 3928 KB cswaits: 11279
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -9 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-9-051220-154853.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--9] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--9] total bytes: 773951797 sent bytes: 340324908 (136151608.00 per second)
    [rsync 3.2.3 xxh128-zstd--9] transfer speed (MB/s): 122.4751 speedup: 2.27
    [rsync 3.2.3 xxh128-zstd--9] real: 2.65s user: 1.10s sys: 0.73s cpu: 69% maxmem: 3928 KB cswaits: 11151
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -8 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-8-051220-154859.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--8] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--8] total bytes: 773951797 sent bytes: 338075130 (135251696.80 per second)
    [rsync 3.2.3 xxh128-zstd--8] transfer speed (MB/s): 122.5907 speedup: 2.29
    [rsync 3.2.3 xxh128-zstd--8] real: 2.63s user: 1.07s sys: 0.76s cpu: 69% maxmem: 3928 KB cswaits: 11095
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -7 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-7-051220-154905.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--7] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--7] total bytes: 773951797 sent bytes: 335401888 (134182400.00 per second)
    [rsync 3.2.3 xxh128-zstd--7] transfer speed (MB/s): 121.6213 speedup: 2.31
    [rsync 3.2.3 xxh128-zstd--7] real: 2.63s user: 1.08s sys: 0.76s cpu: 70% maxmem: 3932 KB cswaits: 11082
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -6 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-6-051220-154910.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--6] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--6] total bytes: 773951797 sent bytes: 332796193 (95100087.14 per second)
    [rsync 3.2.3 xxh128-zstd--6] transfer speed (MB/s): 113.3497 speedup: 2.33
    [rsync 3.2.3 xxh128-zstd--6] real: 2.80s user: 1.31s sys: 0.90s cpu: 79% maxmem: 3932 KB cswaits: 10875
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -5 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-5-051220-154917.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--5] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--5] total bytes: 773951797 sent bytes: 330272064 (132130470.40 per second)
    [rsync 3.2.3 xxh128-zstd--5] transfer speed (MB/s): 113.7082 speedup: 2.34
    [rsync 3.2.3 xxh128-zstd--5] real: 2.77s user: 1.23s sys: 0.87s cpu: 75% maxmem: 3940 KB cswaits: 10954
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -4 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-4-051220-154923.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--4] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--4] total bytes: 773951797 sent bytes: 328438754 (131397146.40 per second)
    [rsync 3.2.3 xxh128-zstd--4] transfer speed (MB/s): 116.8744 speedup: 2.36
    [rsync 3.2.3 xxh128-zstd--4] real: 2.68s user: 1.10s sys: 0.77s cpu: 70% maxmem: 3936 KB cswaits: 10959
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -3 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-3-051220-154929.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--3] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--3] total bytes: 773951797 sent bytes: 325494790 (130219560.80 per second)
    [rsync 3.2.3 xxh128-zstd--3] transfer speed (MB/s): 114.9688 speedup: 2.38
    [rsync 3.2.3 xxh128-zstd--3] real: 2.70s user: 1.16s sys: 0.74s cpu: 70% maxmem: 3944 KB cswaits: 10794
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -2 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-2-051220-154935.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--2] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--2] total bytes: 773951797 sent bytes: 323523844 (129431182.40 per second)
    [rsync 3.2.3 xxh128-zstd--2] transfer speed (MB/s): 120.9946 speedup: 2.39
    [rsync 3.2.3 xxh128-zstd--2] real: 2.55s user: 1.18s sys: 0.73s cpu: 75% maxmem: 3944 KB cswaits: 10758
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -1 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl-1-051220-154940.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd--1] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd--1] total bytes: 773951797 sent bytes: 319706428 (91360154.29 per second)
    [rsync 3.2.3 xxh128-zstd--1] transfer speed (MB/s): 111.2758 speedup: 2.42
    [rsync 3.2.3 xxh128-zstd--1] real: 2.74s user: 1.20s sys: 0.74s cpu: 71% maxmem: 3948 KB cswaits: 10644
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl 0 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl0-051220-154947.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd-0] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd-0] total bytes: 773951797 sent bytes: 303996691 (121620321.20 per second)
    [rsync 3.2.3 xxh128-zstd-0] transfer speed (MB/s): 97.9438 speedup: 2.55
    [rsync 3.2.3 xxh128-zstd-0] real: 2.96s user: 1.59s sys: 0.73s cpu: 78% maxmem: 6248 KB cswaits: 8623
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl 1 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl1-051220-154953.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd-1] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd-1] total bytes: 773951797 sent bytes: 310921418 (88850151.43 per second)
    [rsync 3.2.3 xxh128-zstd-1] transfer speed (MB/s): 105.8992 speedup: 2.49
    [rsync 3.2.3 xxh128-zstd-1] real: 2.80s user: 1.38s sys: 0.72s cpu: 75% maxmem: 3988 KB cswaits: 10258
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl 2 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl2-051220-154959.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd-2] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd-2] total bytes: 773951797 sent bytes: 307790964 (87955736.00 per second)
    [rsync 3.2.3 xxh128-zstd-2] transfer speed (MB/s): 102.9938 speedup: 2.51
    [rsync 3.2.3 xxh128-zstd-2] real: 2.85s user: 1.39s sys: 0.75s cpu: 75% maxmem: 4708 KB cswaits: 10199
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl 3 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl3-051220-155005.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd-3] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd-3] total bytes: 773951797 sent bytes: 303996691 (86871658.00 per second)
    [rsync 3.2.3 xxh128-zstd-3] transfer speed (MB/s): 98.6101 speedup: 2.55
    [rsync 3.2.3 xxh128-zstd-3] real: 2.94s user: 1.52s sys: 0.77s cpu: 78% maxmem: 6248 KB cswaits: 9188
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl 4 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl4-051220-155011.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd-4] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd-4] total bytes: 773951797 sent bytes: 303988206 (86869233.71 per second)
    [rsync 3.2.3 xxh128-zstd-4] transfer speed (MB/s): 93.8206 speedup: 2.55
    [rsync 3.2.3 xxh128-zstd-4] real: 3.09s user: 1.73s sys: 0.76s cpu: 80% maxmem: 7532 KB cswaits: 8591
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl 5 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl5-051220-155018.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd-5] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd-5] total bytes: 773951797 sent bytes: 301135733 (66931076.67 per second)
    [rsync 3.2.3 xxh128-zstd-5] transfer speed (MB/s): 60.4600 speedup: 2.57
    [rsync 3.2.3 xxh128-zstd-5] real: 4.75s user: 3.42s sys: 0.76s cpu: 88% maxmem: 8540 KB cswaits: 8391
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl 6 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvl6-051220-155026.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-zstd-6] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-zstd-6] total bytes: 773951797 sent bytes: 299686228 (54498243.64 per second)
    [rsync 3.2.3 xxh128-zstd-6] transfer speed (MB/s): 55.9301 speedup: 2.58
    [rsync 3.2.3 xxh128-zstd-6] real: 5.11s user: 3.95s sys: 0.80s cpu: 93% maxmem: 9560 KB cswaits: 8355
    
    csv log: /home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvls-051220-154002.csv

    Code (Text):
    cat /home/rsync-benchmarks/rsyncbench-xxh128-zstd-lvls-051220-154002.csv
    version,comp-type,comp-lvl,speed,time,bytes-sent
    rsync-3.2.3,zstd,-100,526.6422,0.91,502524238
    rsync-3.2.3,zstd,-99,193.2164,2.48,502453274
    rsync-3.2.3,zstd,-98,194.6307,2.46,502049349
    rsync-3.2.3,zstd,-97,182.3190,2.62,500879501
    rsync-3.2.3,zstd,-96,192.1051,2.48,499563263
    rsync-3.2.3,zstd,-95,193.1204,2.46,498153689
    rsync-3.2.3,zstd,-94,191.7020,2.47,496505085
    rsync-3.2.3,zstd,-93,186.8039,2.53,495571690
    rsync-3.2.3,zstd,-92,202.3449,2.33,494365618
    rsync-3.2.3,zstd,-91,187.4978,2.51,493480440
    rsync-3.2.3,zstd,-90,189.8933,2.47,491820410
    rsync-3.2.3,zstd,-89,188.4982,2.48,490183797
    rsync-3.2.3,zstd,-88,176.0796,2.65,489277129
    rsync-3.2.3,zstd,-87,189.1803,2.46,487990191
    rsync-3.2.3,zstd,-86,188.1084,2.47,487197617
    rsync-3.2.3,zstd,-85,183.2419,2.53,486122201
    rsync-3.2.3,zstd,-84,200.1395,2.31,484780234
    rsync-3.2.3,zstd,-83,180.1098,2.56,483478631
    rsync-3.2.3,zstd,-82,177.6615,2.59,482495260
    rsync-3.2.3,zstd,-81,184.4255,2.49,481526759
    rsync-3.2.3,zstd,-80,183.1664,2.50,480159728
    rsync-3.2.3,zstd,-79,184.1026,2.48,478753157
    rsync-3.2.3,zstd,-78,181.3459,2.51,477288999
    rsync-3.2.3,zstd,-77,178.3556,2.55,476899601
    rsync-3.2.3,zstd,-76,195.7520,2.32,476205412
    rsync-3.2.3,zstd,-75,183.0673,2.48,476060832
    rsync-3.2.3,zstd,-74,194.7425,2.33,475791488
    rsync-3.2.3,zstd,-73,181.0862,2.51,476605516
    rsync-3.2.3,zstd,-72,172.6800,2.64,478019952
    rsync-3.2.3,zstd,-71,180.4662,2.53,478758547
    rsync-3.2.3,zstd,-70,183.3252,2.48,476731459
    rsync-3.2.3,zstd,-69,180.6880,2.50,473662800
    rsync-3.2.3,zstd,-68,177.9986,2.52,470345777
    rsync-3.2.3,zstd,-67,176.7558,2.52,467061682
    rsync-3.2.3,zstd,-66,186.7380,2.37,464067371
    rsync-3.2.3,zstd,-65,172.3181,2.56,462563095
    rsync-3.2.3,zstd,-64,174.6019,2.52,461370332
    rsync-3.2.3,zstd,-63,168.5962,2.60,459643528
    rsync-3.2.3,zstd,-62,175.6367,2.49,458579559
    rsync-3.2.3,zstd,-61,172.4670,2.53,457537488
    rsync-3.2.3,zstd,-60,162.9172,2.67,456119111
    rsync-3.2.3,zstd,-59,173.3303,2.50,454375186
    rsync-3.2.3,zstd,-58,182.6010,2.36,451871677
    rsync-3.2.3,zstd,-57,161.6724,2.65,449243392
    rsync-3.2.3,zstd,-56,169.8279,2.51,446974550
    rsync-3.2.3,zstd,-55,169.0584,2.51,444949319
    rsync-3.2.3,zstd,-54,165.1974,2.56,443448644
    rsync-3.2.3,zstd,-53,167.6594,2.51,441267106
    rsync-3.2.3,zstd,-52,167.2334,2.50,438392569
    rsync-3.2.3,zstd,-51,164.1281,2.53,435415113
    rsync-3.2.3,zstd,-50,174.5212,2.37,433707259
    rsync-3.2.3,zstd,-49,161.6907,2.55,432339753
    rsync-3.2.3,zstd,-48,162.3431,2.53,430679674
    rsync-3.2.3,zstd,-47,161.2069,2.54,429355974
    rsync-3.2.3,zstd,-46,159.4171,2.56,427932036
    rsync-3.2.3,zstd,-45,151.5503,2.68,425884343
    rsync-3.2.3,zstd,-44,159.9943,2.52,422770844
    rsync-3.2.3,zstd,-43,155.7068,2.57,419605077
    rsync-3.2.3,zstd,-42,166.7826,2.38,416224609
    rsync-3.2.3,zstd,-41,154.5277,2.55,413186825
    rsync-3.2.3,zstd,-40,154.4071,2.54,411245457
    rsync-3.2.3,zstd,-39,152.3280,2.56,408902519
    rsync-3.2.3,zstd,-38,152.1253,2.55,406763185
    rsync-3.2.3,zstd,-37,150.7670,2.56,404712276
    rsync-3.2.3,zstd,-36,142.1817,2.70,402538714
    rsync-3.2.3,zstd,-35,148.0491,2.58,400521259
    rsync-3.2.3,zstd,-34,158.7088,2.39,397739780
    rsync-3.2.3,zstd,-33,145.7463,2.58,394291346
    rsync-3.2.3,zstd,-32,144.9344,2.57,390575206
    rsync-3.2.3,zstd,-31,138.7067,2.67,388336938
    rsync-3.2.3,zstd,-30,142.9108,2.58,386620494
    rsync-3.2.3,zstd,-29,143.7667,2.55,384413549
    rsync-3.2.3,zstd,-28,140.6768,2.59,382051851
    rsync-3.2.3,zstd,-27,139.7193,2.59,379451361
    rsync-3.2.3,zstd,-26,146.0231,2.46,376666143
    rsync-3.2.3,zstd,-25,133.7113,2.67,374351489
    rsync-3.2.3,zstd,-24,137.6120,2.58,372285599
    rsync-3.2.3,zstd,-23,135.3652,2.61,370465323
    rsync-3.2.3,zstd,-22,135.6752,2.59,368468575
    rsync-3.2.3,zstd,-21,128.1318,2.73,366791851
    rsync-3.2.3,zstd,-20,133.5097,2.61,365387281
    rsync-3.2.3,zstd,-19,130.0174,2.67,364009669
    rsync-3.2.3,zstd,-18,134.9678,2.56,362301545
    rsync-3.2.3,zstd,-17,129.6869,2.65,360364658
    rsync-3.2.3,zstd,-16,128.8263,2.65,357973074
    rsync-3.2.3,zstd,-15,130.0353,2.61,355878668
    rsync-3.2.3,zstd,-14,128.6193,2.62,353352063
    rsync-3.2.3,zstd,-13,126.5525,2.64,350327835
    rsync-3.2.3,zstd,-12,126.5341,2.62,347623477
    rsync-3.2.3,zstd,-11,126.0919,2.61,345086348
    rsync-3.2.3,zstd,-10,132.3809,2.47,342864256
    rsync-3.2.3,zstd,-9,122.4751,2.65,340324908
    rsync-3.2.3,zstd,-8,122.5907,2.63,338075130
    rsync-3.2.3,zstd,-7,121.6213,2.63,335401888
    rsync-3.2.3,zstd,-6,113.3497,2.80,332796193
    rsync-3.2.3,zstd,-5,113.7082,2.77,330272064
    rsync-3.2.3,zstd,-4,116.8744,2.68,328438754
    rsync-3.2.3,zstd,-3,114.9688,2.70,325494790
    rsync-3.2.3,zstd,-2,120.9946,2.55,323523844
    rsync-3.2.3,zstd,-1,111.2758,2.74,319706428
    rsync-3.2.3,zstd,0,97.9438,2.96,303996691
    rsync-3.2.3,zstd,1,105.8992,2.80,310921418
    rsync-3.2.3,zstd,2,102.9938,2.85,307790964
    rsync-3.2.3,zstd,3,98.6101,2.94,303996691
    rsync-3.2.3,zstd,4,93.8206,3.09,303988206
    rsync-3.2.3,zstd,5,60.4600,4.75,301135733
    rsync-3.2.3,zstd,6,55.9301,5.11,299686228
    


    rsync 3.2.3 with xxh128 + lz4 for compression levels 1 to 6



    Code (Text):
    ./rsync-benchmark.sh bench-lvl xxh128 lz4 6 /home/rsync-test/ /home/rsync-test-dst/
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc lz4 --zl 1 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-lz4-lvl1-051220-160058.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-lz4-1] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-lz4-1] total bytes: 773951797 sent bytes: 385178200 (110066374.86 per second)
    [rsync 3.2.3 xxh128-lz4-1] transfer speed (MB/s): 152.4209 speedup: 2.01
    [rsync 3.2.3 xxh128-lz4-1] real: 2.41s user: 0.95s sys: 0.79s cpu: 72% maxmem: 2836 KB cswaits: 12410
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc lz4 --zl 2 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-lz4-lvl2-051220-160104.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-lz4-2] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-lz4-2] total bytes: 773951797 sent bytes: 385178200 (110066374.86 per second)
    [rsync 3.2.3 xxh128-lz4-2] transfer speed (MB/s): 141.8280 speedup: 2.01
    [rsync 3.2.3 xxh128-lz4-2] real: 2.59s user: 0.93s sys: 0.83s cpu: 68% maxmem: 2836 KB cswaits: 12417
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc lz4 --zl 3 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-lz4-lvl3-051220-160110.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-lz4-3] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-lz4-3] total bytes: 773951797 sent bytes: 385178200 (110066374.86 per second)
    [rsync 3.2.3 xxh128-lz4-3] transfer speed (MB/s): 143.4900 speedup: 2.01
    [rsync 3.2.3 xxh128-lz4-3] real: 2.56s user: 0.90s sys: 0.79s cpu: 66% maxmem: 2836 KB cswaits: 12450
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc lz4 --zl 4 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-lz4-lvl4-051220-160116.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-lz4-4] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-lz4-4] total bytes: 773951797 sent bytes: 385178200 (154092924.80 per second)
    [rsync 3.2.3 xxh128-lz4-4] transfer speed (MB/s): 144.0527 speedup: 2.01
    [rsync 3.2.3 xxh128-lz4-4] real: 2.55s user: 0.88s sys: 0.80s cpu: 66% maxmem: 2836 KB cswaits: 12419
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc lz4 --zl 5 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-lz4-lvl5-051220-160122.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-lz4-5] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-lz4-5] total bytes: 773951797 sent bytes: 385178200 (154092924.80 per second)
    [rsync 3.2.3 xxh128-lz4-5] transfer speed (MB/s): 142.3777 speedup: 2.01
    [rsync 3.2.3 xxh128-lz4-5] real: 2.58s user: 0.91s sys: 0.78s cpu: 65% maxmem: 2832 KB cswaits: 12425
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc lz4 --zl 6 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-lz4-lvl6-051220-160128.log /home/rsync-test/ /home/rsync-test-dst/
    [rsync 3.2.3 xxh128-lz4-6] files: 2,848 reg: 2,847, dir: 1
    [rsync 3.2.3 xxh128-lz4-6] total bytes: 773951797 sent bytes: 385178200 (154092924.80 per second)
    [rsync 3.2.3 xxh128-lz4-6] transfer speed (MB/s): 143.4900 speedup: 2.01
    [rsync 3.2.3 xxh128-lz4-6] real: 2.56s user: 0.92s sys: 0.77s cpu: 66% maxmem: 2836 KB cswaits: 12414
    
    csv log: /home/rsync-benchmarks/rsyncbench-xxh128-lz4-lvls-051220-160058.csv
    

    Code (Text):
    cat /home/rsync-benchmarks/rsyncbench-xxh128-lz4-lvls-051220-160058.csv
    version,comp-type,comp-lvl,speed,time,bytes-sent
    rsync-3.2.3,lz4,1,152.4209,2.41,385178200
    rsync-3.2.3,lz4,2,141.8280,2.59,385178200
    rsync-3.2.3,lz4,3,143.4900,2.56,385178200
    rsync-3.2.3,lz4,4,144.0527,2.55,385178200
    rsync-3.2.3,lz4,5,142.3777,2.58,385178200
    rsync-3.2.3,lz4,6,143.4900,2.56,385178200
    


    Table for rsync 3.1.2 native levels 1 to 6 and rsync 3.2.3 zstd and lz4 with xxh128 for all compression levels -100 to 6.
    • Compression ratio wise, rsync 3.2.3 zstd with xxh128 checksum needs fast -29 compression level to end up sending around the same amount of bytes as lz4 compression. At zstd -29 speed is ~143.8MB/s while lz4 is around 143.5MB/s at lz4 default level 6 compression.
    • rsync 3.2.3 zstd -100 compression level is interesting as the speed was much faster at ~526.6MB/s but zstd -99 drops back to ~193.2MB/s.
    • rsync 3.2.3 ztsd -1 compression level is enough to match rsync 3.1.2's compression ratio and bytes sent but does so at ~111MB/s vs rsync 3.1.2's 22MB/s !

    rsync-3.2.3-compression-level-table.png
     
    Last edited: Dec 6, 2020
  4. eva2000

    eva2000 Administrator Staff Member

    47,294
    10,705
    113
    May 24, 2014
    Brisbane, Australia
    Ratings:
    +16,631
    Local Time:
    9:54 AM
    Nginx 1.19.x
    MariaDB 5.5/10.x
    With possible rsync 3.2.3 zlib bug with pre-compressed files in the transfer queue, I decided to retest by removing the pre-compressed files and only test rsync's performance with uncompressed text .log log files. I also added additional zstd compression fast negative levels for -30, -60, -150, -350 and -8000 to showcase how flexible zstd is in allowing you to choose speed versus compression ratio/sizes. For rsync 3.2.3 zstd there are compression levels from -131072 to 22.

    Code (Text):
    du -sh /home/rsync-test-no-precomp
    495M    /home/rsync-test-no-precomp
    

    Code (Text):
    ./rsync-benchmark.sh bench-native /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    
    /usr/bin/rsync -avzi --stats --log-file=/home/rsync-benchmarks/rsyncbench-rsync-native-compressed-051220-224524.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.1.2 native compressed] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.1.2 native compressed] total bytes: 510556971 sent bytes: 55648190 (6553198.59 per second)
    [rsync 3.1.2 native compressed] transfer speed (MB/s): 6.8922 speedup: 9.17
    [rsync 3.1.2 native compressed] real: 7.70s user: 7.66s sys: 0.50s cpu: 106% maxmem: 2332 KB cswaits: 5855
    
    /usr/bin/rsync -avi --stats --log-file=/home/rsync-benchmarks/rsyncbench-rsync-native-no-compress-051220-224524.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.1.2 native no-compress] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.1.2 native no-compress] total bytes: 510556971 sent bytes: 510977977 (204412790.00 per second)
    [rsync 3.1.2 native no-compress] transfer speed (MB/s): 213.7309 speedup: 1.00
    [rsync 3.1.2 native no-compress] real: 2.28s user: 1.66s sys: 0.79s cpu: 107% maxmem: 1988 KB cswaits: 16267
    
    csv log: /home/rsync-benchmarks/rsyncbench-rsync-native-051220-224524.csv
    
    version,speed,time,cpu%,mem (KB),bytes-sent,megabytes-sent
    rsync-3.1.2-compress,6.8922,7.70,106%,2332,55648190,53.0702
    rsync-3.1.2-no-compress,213.7309,2.28,107%,1988,510977977,487.3065
    


    Code (Text):
    ./rsync-benchmark.sh bench /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc lz4 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-lz4-051220-232925.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh128-lz4] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh128-lz4] total bytes: 510556971 sent bytes: 120607067 (48264426.00 per second)
    [rsync 3.2.3 xxh128-lz4] transfer speed (MB/s): 62.1728 speedup: 4.23
    [rsync 3.2.3 xxh128-lz4] real: 1.85s user: 0.72s sys: 0.51s cpu: 66% maxmem: 2844 KB cswaits: 7452
    
    /usr/local/bin/rsync -avzi --stats --cc xxh3 --zc lz4 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh3-lz4-051220-232928.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh3-lz4] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh3-lz4] total bytes: 510556971 sent bytes: 120584339 (48255334.80 per second)
    [rsync 3.2.3 xxh3-lz4] transfer speed (MB/s): 61.8269 speedup: 4.23
    [rsync 3.2.3 xxh3-lz4] real: 1.86s user: 0.72s sys: 0.51s cpu: 66% maxmem: 2788 KB cswaits: 7455
    
    /usr/local/bin/rsync -avzi --stats --cc xxh64 --zc lz4 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh64-lz4-051220-232932.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh64-lz4] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh64-lz4] total bytes: 510556971 sent bytes: 120584339 (48255334.80 per second)
    [rsync 3.2.3 xxh64-lz4] transfer speed (MB/s): 62.4990 speedup: 4.23
    [rsync 3.2.3 xxh64-lz4] real: 1.84s user: 0.71s sys: 0.50s cpu: 66% maxmem: 2780 KB cswaits: 7477
    
    /usr/local/bin/rsync -avzi --stats --cc xxhash --zc lz4 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxhash-lz4-051220-232936.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxhash-lz4] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxhash-lz4] total bytes: 510556971 sent bytes: 120584339 (48255334.80 per second)
    [rsync 3.2.3 xxhash-lz4] transfer speed (MB/s): 61.8269 speedup: 4.23
    [rsync 3.2.3 xxhash-lz4] real: 1.86s user: 0.74s sys: 0.50s cpu: 66% maxmem: 2780 KB cswaits: 7466
    
    /usr/local/bin/rsync -avzi --stats --cc md5 --zc lz4 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-md5-lz4-051220-232939.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 md5-lz4] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 md5-lz4] total bytes: 510556971 sent bytes: 120607067 (34474590.00 per second)
    [rsync 3.2.3 md5-lz4] transfer speed (MB/s): 47.9249 speedup: 4.23
    [rsync 3.2.3 md5-lz4] real: 2.40s user: 1.91s sys: 0.55s cpu: 102% maxmem: 2788 KB cswaits: 6874
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-051220-232943.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh128-zstd] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh128-zstd] total bytes: 510556971 sent bytes: 40542511 (11599002.57 per second)
    [rsync 3.2.3 xxh128-zstd] transfer speed (MB/s): 17.4163 speedup: 12.58
    [rsync 3.2.3 xxh128-zstd] real: 2.22s user: 1.28s sys: 0.48s cpu: 79% maxmem: 6044 KB cswaits: 5807
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -30 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-051220-232947.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh128-zstd--30 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh128-zstd--30 total bytes: 510556971 sent bytes: 123128983 (49273192.40 per second)
    [rsync 3.2.3 xxh128-zstd--30 transfer speed (MB/s): 61.4790 speedup: 4.14
    [rsync 3.2.3 xxh128-zstd--30 real: 1.91s user: 0.87s sys: 0.49s cpu: 71% maxmem: 3844 KB cswaits: 7575
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -60 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-051220-232951.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh128-zstd--60 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh128-zstd--60 total bytes: 510556971 sent bytes: 192636681 (77076271.60 per second)
    [rsync 3.2.3 xxh128-zstd--60 transfer speed (MB/s): 100.9410 speedup: 2.65
    [rsync 3.2.3 xxh128-zstd--60 real: 1.82s user: 0.69s sys: 0.53s cpu: 67% maxmem: 3872 KB cswaits: 7760
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -150 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-051220-232955.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh128-zstd--150 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh128-zstd--150 total bytes: 510556971 sent bytes: 278423932 (185651953.33 per second)
    [rsync 3.2.3 xxh128-zstd--150 transfer speed (MB/s): 147.5143 speedup: 1.83
    [rsync 3.2.3 xxh128-zstd--150 real: 1.80s user: 0.61s sys: 0.57s cpu: 66% maxmem: 3896 KB cswaits: 8891
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -350 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-051220-232958.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh128-zstd--350 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh128-zstd--350 total bytes: 510556971 sent bytes: 350131076 (140074029.60 per second)
    [rsync 3.2.3 xxh128-zstd--350 transfer speed (MB/s): 193.0121 speedup: 1.46
    [rsync 3.2.3 xxh128-zstd--350 real: 1.73s user: 0.44s sys: 0.56s cpu: 58% maxmem: 3904 KB cswaits: 10096
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zstd --zl -8000 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zstd-051220-233002.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh128-zstd--8000 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh128-zstd--8000 total bytes: 510556971 sent bytes: 502664954 (335145968.00 per second)
    [rsync 3.2.3 xxh128-zstd--8000 transfer speed (MB/s): 277.0974 speedup: 1.02
    [rsync 3.2.3 xxh128-zstd--8000 real: 1.73s user: 0.34s sys: 0.62s cpu: 56% maxmem: 3888 KB cswaits: 13102
    
    /usr/local/bin/rsync -avzi --stats --cc xxh3 --zc zstd --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh3-zstd-051220-233005.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh3-zstd] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh3-zstd] total bytes: 510556971 sent bytes: 40519779 (16229510.80 per second)
    [rsync 3.2.3 xxh3-zstd] transfer speed (MB/s): 17.4853 speedup: 12.58
    [rsync 3.2.3 xxh3-zstd] real: 2.21s user: 1.26s sys: 0.47s cpu: 78% maxmem: 6040 KB cswaits: 5824
    
    /usr/local/bin/rsync -avzi --stats --cc xxh3 --zc zstd --zl -30 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh3-zstd-051220-233009.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh3-zstd--30 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh3-zstd--30 total bytes: 510556971 sent bytes: 123106255 (49264101.20 per second)
    [rsync 3.2.3 xxh3-zstd--30 transfer speed (MB/s): 59.8996 speedup: 4.15
    [rsync 3.2.3 xxh3-zstd--30 real: 1.96s user: 0.95s sys: 0.54s cpu: 76% maxmem: 3836 KB cswaits: 7553
    
    /usr/local/bin/rsync -avzi --stats --cc xxh3 --zc zstd --zl -60 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh3-zstd-051220-233013.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh3-zstd--60 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh3-zstd--60 total bytes: 510556971 sent bytes: 192613953 (77067180.40 per second)
    [rsync 3.2.3 xxh3-zstd--60 transfer speed (MB/s): 99.2924 speedup: 2.65
    [rsync 3.2.3 xxh3-zstd--60 real: 1.85s user: 0.73s sys: 0.57s cpu: 70% maxmem: 3860 KB cswaits: 7647
    
    /usr/local/bin/rsync -avzi --stats --cc xxh3 --zc zstd --zl -150 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh3-zstd-051220-233017.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh3-zstd--150 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh3-zstd--150 total bytes: 510556971 sent bytes: 278401204 (185636801.33 per second)
    [rsync 3.2.3 xxh3-zstd--150 transfer speed (MB/s): 150.0023 speedup: 1.83
    [rsync 3.2.3 xxh3-zstd--150 real: 1.77s user: 0.56s sys: 0.55s cpu: 62% maxmem: 3888 KB cswaits: 8960
    
    /usr/local/bin/rsync -avzi --stats --cc xxh3 --zc zstd --zl -350 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh3-zstd-051220-233020.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh3-zstd--350 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh3-zstd--350 total bytes: 510556971 sent bytes: 350108348 (140064938.40 per second)
    [rsync 3.2.3 xxh3-zstd--350 transfer speed (MB/s): 191.8904 speedup: 1.46
    [rsync 3.2.3 xxh3-zstd--350 real: 1.74s user: 0.43s sys: 0.58s cpu: 58% maxmem: 3900 KB cswaits: 10085
    
    /usr/local/bin/rsync -avzi --stats --cc xxh3 --zc zstd --zl -8000 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh3-zstd-051220-233024.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh3-zstd--8000 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh3-zstd--8000 total bytes: 510556971 sent bytes: 502642226 (335130816.00 per second)
    [rsync 3.2.3 xxh3-zstd--8000 transfer speed (MB/s): 275.4925 speedup: 1.02
    [rsync 3.2.3 xxh3-zstd--8000 real: 1.74s user: 0.35s sys: 0.69s cpu: 59% maxmem: 3884 KB cswaits: 12927
    
    /usr/local/bin/rsync -avzi --stats --cc xxh64 --zc zstd --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh64-zstd-051220-233027.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh64-zstd] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh64-zstd] total bytes: 510556971 sent bytes: 40519779 (16229510.80 per second)
    [rsync 3.2.3 xxh64-zstd] transfer speed (MB/s): 17.4853 speedup: 12.58
    [rsync 3.2.3 xxh64-zstd] real: 2.21s user: 1.27s sys: 0.47s cpu: 78% maxmem: 6028 KB cswaits: 5797
    
    /usr/local/bin/rsync -avzi --stats --cc xxh64 --zc zstd --zl -30 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh64-zstd-051220-233031.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh64-zstd--30 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh64-zstd--30 total bytes: 510556971 sent bytes: 123106255 (49264101.20 per second)
    [rsync 3.2.3 xxh64-zstd--30 transfer speed (MB/s): 62.4485 speedup: 4.15
    [rsync 3.2.3 xxh64-zstd--30 real: 1.88s user: 0.82s sys: 0.50s cpu: 70% maxmem: 3824 KB cswaits: 7534
    
    /usr/local/bin/rsync -avzi --stats --cc xxh64 --zc zstd --zl -60 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh64-zstd-051220-233035.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh64-zstd--60 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh64-zstd--60 total bytes: 510556971 sent bytes: 192613953 (128445300.67 per second)
    [rsync 3.2.3 xxh64-zstd--60 transfer speed (MB/s): 100.9291 speedup: 2.65
    [rsync 3.2.3 xxh64-zstd--60 real: 1.82s user: 0.71s sys: 0.53s cpu: 68% maxmem: 3852 KB cswaits: 7642
    
    /usr/local/bin/rsync -avzi --stats --cc xxh64 --zc zstd --zl -150 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh64-zstd-051220-233038.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh64-zstd--150 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh64-zstd--150 total bytes: 510556971 sent bytes: 278401204 (111382080.80 per second)
    [rsync 3.2.3 xxh64-zstd--150 transfer speed (MB/s): 150.0023 speedup: 1.83
    [rsync 3.2.3 xxh64-zstd--150 real: 1.77s user: 0.55s sys: 0.56s cpu: 62% maxmem: 3876 KB cswaits: 8925
    
    /usr/local/bin/rsync -avzi --stats --cc xxh64 --zc zstd --zl -350 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh64-zstd-051220-233042.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh64-zstd--350 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh64-zstd--350 total bytes: 510556971 sent bytes: 350108348 (233441564.00 per second)
    [rsync 3.2.3 xxh64-zstd--350 transfer speed (MB/s): 192.9996 speedup: 1.46
    [rsync 3.2.3 xxh64-zstd--350 real: 1.73s user: 0.44s sys: 0.58s cpu: 59% maxmem: 3892 KB cswaits: 10035
    
    /usr/local/bin/rsync -avzi --stats --cc xxh64 --zc zstd --zl -8000 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh64-zstd-051220-233045.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh64-zstd--8000 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh64-zstd--8000 total bytes: 510556971 sent bytes: 502642226 (201078489.60 per second)
    [rsync 3.2.3 xxh64-zstd--8000 transfer speed (MB/s): 273.9182 speedup: 1.02
    [rsync 3.2.3 xxh64-zstd--8000 real: 1.75s user: 0.33s sys: 0.65s cpu: 56% maxmem: 3876 KB cswaits: 12991
    
    /usr/local/bin/rsync -avzi --stats --cc xxhash --zc zstd --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxhash-zstd-051220-233049.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxhash-zstd] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxhash-zstd] total bytes: 510556971 sent bytes: 40519779 (16229510.80 per second)
    [rsync 3.2.3 xxhash-zstd] transfer speed (MB/s): 17.7259 speedup: 12.58
    [rsync 3.2.3 xxhash-zstd] real: 2.18s user: 1.20s sys: 0.50s cpu: 78% maxmem: 6028 KB cswaits: 5828
    
    /usr/local/bin/rsync -avzi --stats --cc xxhash --zc zstd --zl -30 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxhash-zstd-051220-233053.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxhash-zstd--30 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxhash-zstd--30 total bytes: 510556971 sent bytes: 123106255 (49264101.20 per second)
    [rsync 3.2.3 xxhash-zstd--30 transfer speed (MB/s): 62.4485 speedup: 4.15
    [rsync 3.2.3 xxhash-zstd--30 real: 1.88s user: 0.82s sys: 0.49s cpu: 70% maxmem: 3824 KB cswaits: 7551
    
    /usr/local/bin/rsync -avzi --stats --cc xxhash --zc zstd --zl -60 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxhash-zstd-051220-233056.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxhash-zstd--60 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxhash-zstd--60 total bytes: 510556971 sent bytes: 192613953 (77067180.40 per second)
    [rsync 3.2.3 xxhash-zstd--60 transfer speed (MB/s): 100.9291 speedup: 2.65
    [rsync 3.2.3 xxhash-zstd--60 real: 1.82s user: 0.71s sys: 0.54s cpu: 68% maxmem: 3848 KB cswaits: 7632
    
    /usr/local/bin/rsync -avzi --stats --cc xxhash --zc zstd --zl -150 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxhash-zstd-051220-233100.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxhash-zstd--150 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxhash-zstd--150 total bytes: 510556971 sent bytes: 278401204 (111382080.80 per second)
    [rsync 3.2.3 xxhash-zstd--150 transfer speed (MB/s): 150.8545 speedup: 1.83
    [rsync 3.2.3 xxhash-zstd--150 real: 1.76s user: 0.54s sys: 0.56s cpu: 62% maxmem: 3876 KB cswaits: 8964
    
    /usr/local/bin/rsync -avzi --stats --cc xxhash --zc zstd --zl -350 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxhash-zstd-051220-233103.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxhash-zstd--350 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxhash-zstd--350 total bytes: 510556971 sent bytes: 350108348 (140064938.40 per second)
    [rsync 3.2.3 xxhash-zstd--350 transfer speed (MB/s): 186.5303 speedup: 1.46
    [rsync 3.2.3 xxhash-zstd--350 real: 1.79s user: 0.53s sys: 0.64s cpu: 65% maxmem: 3892 KB cswaits: 9756
    
    /usr/local/bin/rsync -avzi --stats --cc xxhash --zc zstd --zl -8000 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxhash-zstd-051220-233107.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxhash-zstd--8000 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxhash-zstd--8000 total bytes: 510556971 sent bytes: 502642226 (201078489.60 per second)
    [rsync 3.2.3 xxhash-zstd--8000 transfer speed (MB/s): 277.0849 speedup: 1.02
    [rsync 3.2.3 xxhash-zstd--8000 real: 1.73s user: 0.31s sys: 0.66s cpu: 56% maxmem: 3876 KB cswaits: 13039
    
    /usr/local/bin/rsync -avzi --stats --cc md5 --zc zstd --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-md5-zstd-051220-233110.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 md5-zstd] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 md5-zstd] total bytes: 510556971 sent bytes: 40542511 (11599002.57 per second)
    [rsync 3.2.3 md5-zstd] transfer speed (MB/s): 14.1110 speedup: 12.58
    [rsync 3.2.3 md5-zstd] real: 2.74s user: 2.40s sys: 0.50s cpu: 105% maxmem: 6036 KB cswaits: 5414
    
    /usr/local/bin/rsync -avzi --stats --cc md5 --zc zstd --zl -30 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-md5-zstd-051220-233115.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 md5-zstd--30 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 md5-zstd--30 total bytes: 510556971 sent bytes: 123128983 (49273192.40 per second)
    [rsync 3.2.3 md5-zstd--30 transfer speed (MB/s): 48.9270 speedup: 4.14
    [rsync 3.2.3 md5-zstd--30 real: 2.40s user: 1.98s sys: 0.51s cpu: 104% maxmem: 3832 KB cswaits: 6868
    
    /usr/local/bin/rsync -avzi --stats --cc md5 --zc zstd --zl -60 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-md5-zstd-051220-233119.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 md5-zstd--60 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 md5-zstd--60 total bytes: 510556971 sent bytes: 192636681 (77076271.60 per second)
    [rsync 3.2.3 md5-zstd--60 transfer speed (MB/s): 78.5096 speedup: 2.65
    [rsync 3.2.3 md5-zstd--60 real: 2.34s user: 1.84s sys: 0.55s cpu: 102% maxmem: 3856 KB cswaits: 6961
    
    /usr/local/bin/rsync -avzi --stats --cc md5 --zc zstd --zl -150 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-md5-zstd-051220-233123.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 md5-zstd--150 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 md5-zstd--150 total bytes: 510556971 sent bytes: 278423932 (111391172.00 per second)
    [rsync 3.2.3 md5-zstd--150 transfer speed (MB/s): 116.4586 speedup: 1.83
    [rsync 3.2.3 md5-zstd--150 real: 2.28s user: 1.69s sys: 0.58s cpu: 99% maxmem: 3884 KB cswaits: 8327
    
    /usr/local/bin/rsync -avzi --stats --cc md5 --zc zstd --zl -350 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-md5-zstd-051220-233127.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 md5-zstd--350 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 md5-zstd--350 total bytes: 510556971 sent bytes: 350131076 (140074029.60 per second)
    [rsync 3.2.3 md5-zstd--350 transfer speed (MB/s): 148.4048 speedup: 1.46
    [rsync 3.2.3 md5-zstd--350 real: 2.25s user: 1.63s sys: 0.55s cpu: 97% maxmem: 3896 KB cswaits: 9294
    
    /usr/local/bin/rsync -avzi --stats --cc md5 --zc zstd --zl -8000 --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-md5-zstd-051220-233131.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 md5-zstd--8000 files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 md5-zstd--8000 total bytes: 510556971 sent bytes: 502664954 (201087580.80 per second)
    [rsync 3.2.3 md5-zstd--8000 transfer speed (MB/s): 214.0083 speedup: 1.02
    [rsync 3.2.3 md5-zstd--8000 real: 2.24s user: 1.51s sys: 0.61s cpu: 94% maxmem: 3880 KB cswaits: 11486
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc zlib --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-zlib-051220-233135.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh128-zlib] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh128-zlib] total bytes: 510556971 sent bytes: 55648201 (7426959.87 per second)
    [rsync 3.2.3 xxh128-zlib] transfer speed (MB/s): 7.6031 speedup: 9.17
    [rsync 3.2.3 xxh128-zlib] real: 6.98s user: 6.42s sys: 0.49s cpu: 99% maxmem: 3052 KB cswaits: 5883
    
    /usr/local/bin/rsync -avzi --stats --cc xxh3 --zc zlib --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh3-zlib-051220-233144.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh3-zlib] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh3-zlib] total bytes: 510556971 sent bytes: 55625469 (7423928.93 per second)
    [rsync 3.2.3 xxh3-zlib] transfer speed (MB/s): 7.5783 speedup: 9.17
    [rsync 3.2.3 xxh3-zlib] real: 7.00s user: 6.45s sys: 0.48s cpu: 99% maxmem: 3044 KB cswaits: 5894
    
    /usr/local/bin/rsync -avzi --stats --cc xxh64 --zc zlib --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh64-zlib-051220-233153.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh64-zlib] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh64-zlib] total bytes: 510556971 sent bytes: 55625469 (7423928.93 per second)
    [rsync 3.2.3 xxh64-zlib] transfer speed (MB/s): 7.6000 speedup: 9.17
    [rsync 3.2.3 xxh64-zlib] real: 6.98s user: 6.44s sys: 0.47s cpu: 99% maxmem: 3032 KB cswaits: 5892
    
    /usr/local/bin/rsync -avzi --stats --cc xxhash --zc zlib --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxhash-zlib-051220-233201.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxhash-zlib] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxhash-zlib] total bytes: 510556971 sent bytes: 55625469 (7423928.93 per second)
    [rsync 3.2.3 xxhash-zlib] transfer speed (MB/s): 7.5892 speedup: 9.17
    [rsync 3.2.3 xxhash-zlib] real: 6.99s user: 6.41s sys: 0.51s cpu: 99% maxmem: 3032 KB cswaits: 5888
    
    /usr/local/bin/rsync -avzi --stats --cc md5 --zc zlib --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-md5-zlib-051220-233210.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 md5-zlib] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 md5-zlib] total bytes: 510556971 sent bytes: 55648201 (6553199.88 per second)
    [rsync 3.2.3 md5-zlib] transfer speed (MB/s): 7.0106 speedup: 9.17
    [rsync 3.2.3 md5-zlib] real: 7.57s user: 7.60s sys: 0.49s cpu: 106% maxmem: 3040 KB cswaits: 5882
    
    /usr/local/bin/rsync -avzi --stats --cc xxh128 --zc none --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh128-none-051220-233220.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh128-none] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh128-none] total bytes: 510556971 sent bytes: 510977988 (340687990.67 per second)
    [rsync 3.2.3 xxh128-none] transfer speed (MB/s): 284.9746 speedup: 1.00
    [rsync 3.2.3 xxh128-none] real: 1.71s user: 0.18s sys: 0.69s cpu: 51% maxmem: 2744 KB cswaits: 19841
    
    /usr/local/bin/rsync -avzi --stats --cc xxh3 --zc none --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh3-none-051220-233223.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh3-none] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh3-none] total bytes: 510556971 sent bytes: 510955260 (204403703.20 per second)
    [rsync 3.2.3 xxh3-none] transfer speed (MB/s): 283.3051 speedup: 1.00
    [rsync 3.2.3 xxh3-none] real: 1.72s user: 0.22s sys: 0.69s cpu: 53% maxmem: 2744 KB cswaits: 19747
    
    /usr/local/bin/rsync -avzi --stats --cc xxh64 --zc none --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxh64-none-051220-233226.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxh64-none] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxh64-none] total bytes: 510556971 sent bytes: 510955260 (204403703.20 per second)
    [rsync 3.2.3 xxh64-none] transfer speed (MB/s): 283.3051 speedup: 1.00
    [rsync 3.2.3 xxh64-none] real: 1.72s user: 0.20s sys: 0.70s cpu: 52% maxmem: 2740 KB cswaits: 19719
    
    /usr/local/bin/rsync -avzi --stats --cc xxhash --zc none --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-xxhash-none-051220-233230.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 xxhash-none] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 xxhash-none] total bytes: 510556971 sent bytes: 510955260 (204403703.20 per second)
    [rsync 3.2.3 xxhash-none] transfer speed (MB/s): 286.6381 speedup: 1.00
    [rsync 3.2.3 xxhash-none] real: 1.70s user: 0.20s sys: 0.68s cpu: 51% maxmem: 2744 KB cswaits: 19845
    
    /usr/local/bin/rsync -avzi --stats --cc md5 --zc none --debug=NSTR --log-file=/home/rsync-benchmarks/rsyncbench-md5-none-051220-233233.log /home/rsync-test-no-precomp/ /home/rsync-test-no-precomp-dst/
    [rsync 3.2.3 md5-none] files: 2,842 reg: 2,841, dir: 1
    [rsync 3.2.3 md5-none] total bytes: 510556971 sent bytes: 510977988 (204412794.40 per second)
    [rsync 3.2.3 md5-none] transfer speed (MB/s): 228.7824 speedup: 1.00
    [rsync 3.2.3 md5-none] real: 2.13s user: 1.38s sys: 0.67s cpu: 96% maxmem: 2740 KB cswaits: 17281
    
    csv log: /home/rsync-benchmarks/rsyncbench-checksum-comp-list-051220-232925.csv
    
    version,speed,time,cpu%,mem (kb),bytes-sent,megabytes-sent
    rsync-3.2.3-xxh128-lz4,62.1728,1.85,66%,2844,120607067,115.0198
    rsync-3.2.3-xxh3-lz4,61.8269,1.86,66%,2788,120584339,114.9981
    rsync-3.2.3-xxh64-lz4,62.4990,1.84,66%,2780,120584339,114.9981
    rsync-3.2.3-xxhash-lz4,61.8269,1.86,66%,2780,120584339,114.9981
    rsync-3.2.3-md5-lz4,47.9249,2.40,102%,2788,120607067,115.0198
    rsync-3.2.3-xxh128-zstd,17.4163,2.22,79%,6044,40542511,38.6643
    rsync-3.2.3-xxh128-zstd--30,61.4790,1.91,71%,3844,123128983,117.4249
    rsync-3.2.3-xxh128-zstd--60,100.9410,1.82,67%,3872,192636681,183.7126
    rsync-3.2.3-xxh128-zstd--150,147.5143,1.80,66%,3896,278423932,265.5257
    rsync-3.2.3-xxh128-zstd--350,193.0121,1.73,58%,3904,350131076,333.9110
    rsync-3.2.3-xxh128-zstd--8000,277.0974,1.73,56%,3888,502664954,479.3786
    rsync-3.2.3-xxh3-zstd,17.4853,2.21,78%,6040,40519779,38.6426
    rsync-3.2.3-xxh3-zstd--30,59.8996,1.96,76%,3836,123106255,117.4032
    rsync-3.2.3-xxh3-zstd--60,99.2924,1.85,70%,3860,192613953,183.6909
    rsync-3.2.3-xxh3-zstd--150,150.0023,1.77,62%,3888,278401204,265.5040
    rsync-3.2.3-xxh3-zstd--350,191.8904,1.74,58%,3900,350108348,333.8893
    rsync-3.2.3-xxh3-zstd--8000,275.4925,1.74,59%,3884,502642226,479.3569
    rsync-3.2.3-xxh64-zstd,17.4853,2.21,78%,6028,40519779,38.6426
    rsync-3.2.3-xxh64-zstd--30,62.4485,1.88,70%,3824,123106255,117.4032
    rsync-3.2.3-xxh64-zstd--60,100.9291,1.82,68%,3852,192613953,183.6909
    rsync-3.2.3-xxh64-zstd--150,150.0023,1.77,62%,3876,278401204,265.5040
    rsync-3.2.3-xxh64-zstd--350,192.9996,1.73,59%,3892,350108348,333.8893
    rsync-3.2.3-xxh64-zstd--8000,273.9182,1.75,56%,3876,502642226,479.3569
    rsync-3.2.3-xxhash-zstd,17.7259,2.18,78%,6028,40519779,38.6426
    rsync-3.2.3-xxhash-zstd--30,62.4485,1.88,70%,3824,123106255,117.4032
    rsync-3.2.3-xxhash-zstd--60,100.9291,1.82,68%,3848,192613953,183.6909
    rsync-3.2.3-xxhash-zstd--150,150.8545,1.76,62%,3876,278401204,265.5040
    rsync-3.2.3-xxhash-zstd--350,186.5303,1.79,65%,3892,350108348,333.8893
    rsync-3.2.3-xxhash-zstd--8000,277.0849,1.73,56%,3876,502642226,479.3569
    rsync-3.2.3-md5-zstd,14.1110,2.74,105%,6036,40542511,38.6643
    rsync-3.2.3-md5-zstd--30,48.9270,2.40,104%,3832,123128983,117.4249
    rsync-3.2.3-md5-zstd--60,78.5096,2.34,102%,3856,192636681,183.7126
    rsync-3.2.3-md5-zstd--150,116.4586,2.28,99%,3884,278423932,265.5257
    rsync-3.2.3-md5-zstd--350,148.4048,2.25,97%,3896,350131076,333.9110
    rsync-3.2.3-md5-zstd--8000,214.0083,2.24,94%,3880,502664954,479.3786
    rsync-3.2.3-xxh128-zlib,7.6031,6.98,99%,3052,55648201,53.0702
    rsync-3.2.3-xxh3-zlib,7.5783,7.00,99%,3044,55625469,53.0485
    rsync-3.2.3-xxh64-zlib,7.6000,6.98,99%,3032,55625469,53.0485
    rsync-3.2.3-xxhash-zlib,7.5892,6.99,99%,3032,55625469,53.0485
    rsync-3.2.3-md5-zlib,7.0106,7.57,106%,3040,55648201,53.0702
    rsync-3.2.3-xxh128-none,284.9746,1.71,51%,2744,510977988,487.3065
    rsync-3.2.3-xxh3-none,283.3051,1.72,53%,2744,510955260,487.2849
    rsync-3.2.3-xxh64-none,283.3051,1.72,52%,2740,510955260,487.2849
    rsync-3.2.3-xxhash-none,286.6381,1.70,51%,2744,510955260,487.2849
    rsync-3.2.3-md5-none,228.7824,2.13,96%,2740,510977988,487.3065
    


    rsync-benchmark-061220-table.png

    rsync-benchmark-061220-chart.png
     
Thread Status:
Not open for further replies.