Video - https://www.youtube.com/watch?v=jvF_AkAnVkM
https://www.1range1.com - file sync and copier
--------------------------------
non-internet results(traditional filecopier)
--------------------------------
Direct directory-to-directory mirror within current worksystem(no internet involved)
$ time copier -avz --progress "/data/virtual/" --mkpath="/vm/datadrive" "/vm/datadrive"
sent 62,818,190 bytes received 357 bytes 125,637,094.00 bytes/sec
total size is 63,547,959 speedup is 1.01
real0m0.422s <-- total time to complete
user0m0.121s
sys0m0.078s
--------------------------------
non-internet results(vrangesync)
--------------------------------
Direct directory-to-directory mirror within current worksystem(no internet involved)
time ./vr -i "/data/virtual" -o "/vm/datadrive"
real0m0.114s <-- total time to complete
user0m0.033s
sys0m0.093s
--------------------------------
internet results(Traditional filecopier(ssh))
--------------------------------
Direct directory-to-directory mirror over the wire (internet involved)
$ time copier -avz --progress "/data/virtual/" --mkpath="/vm/datadrive" -e "ssh -p12345" root@1.2.3.4:/vm/datadrive
sent 62,818,190 bytes received 399 bytes 5,982,722.76 bytes/sec
total size is 63,547,959 speedup is 1.01
real0m10.363s
user0m0.311s
sys0m0.088s
--------------------------------
internet results(VRangesync(ssh))
--------------------------------
Direct directory-to-directory mirror over the wire (internet involved)
time ./vr -i "/data/virtual" -o "/vm/datadrive" -da "root@1.2.3.4" -dp "12345" -df "1.2.3.4.txt"
real0m10.155s
user0m0.181s
sys0m0.259s
--------------------------------
internet results(VRangesync(ncat))
--------------------------------
Direct directory-to-directory mirror over the wire (internet involved)
#ncat, data scamble using compression algorithm; 'zstd'(parallel), custom ncat port
time
./vr -i "/data/virtual" -o "/vm/datadrive" -da "root@1.2.3.4" -dp
"12345" -df "1.2.3.4.txt" -nc "1" -z "zstd" -ncport "9090"
real0m8.999s
user0m0.149s
sys0m0.319s
# ncat, data scamble using compression algorithm; 'lz4', custom ncat port
time ./vr -i "/data/virtual" -o "/vm/datadrive" -da "root@1.2.3.4" -dp "12345" -df "1.2.3.4.txt" -nc "1" -z "lz4" -ncport "9090"
real0m9.121s
user0m0.264s
sys0m0.677s
#
ncat, data scamble using 'zstd'(parallel) compression algorithm;
custom random ncat port(7000-10000)(auto select one of the ports)
time ./vr -i "/data/virtual" -o "/vm/datadrive" -da "root@1.2.3.4" -dp "12345" -df "1.2.3.4.txt" -nc "1" -ncport "7000-10000"
real0m9.167s
user0m0.169s
sys0m0.342s
=====================
Results
=====================
***********************
Direct directory-to-directory mirror within current worksystem(no internet involved)
Traditional filecopier - 0m0.422s
VRangesync - 0m0.114s
VRangesync 0m0.114s timing prove itself as the ideal file copier choice for sync within current worksystem
***********************
Direct directory-to-directory mirror over the wire (internet involved)
Traditional filecopier(ssh) - 0m10.363s
VRangesync(ssh) - 0m10.155s
VRangesync(ncat)[zstd] - 0m8.999s
VRangesync(ncat)[lz4] - 0m9.121s
VRangesync(ncat)[zstd](random) - 0m9.167s
VRangesync(ncat)[zstd] and VRangesync(ncat)[lz4] timing proved themselves as the ideal file copier choice
for remote transport
No comments:
Post a Comment