search

fast-data-transfer / fdt

FDT is an Application for Efficient Data Transfers which is capable of reading and writing at disk speed over wide area networks (with standard TCP). It is written in Java, runs an all major platforms and it is easy to use. FDT is based on an asynchronous, flexible multithreaded system and is using the capabilities of the Java NIO libraries.
https://fast-data-transfer.github.io/
Apache License 2.0
201 stars 45 forks source link

Question about FDT #67

Open av930 opened 2 years ago

av930 commented 2 years ago

Thanks for this amazing tool, FDT. I wonder some points. 1) When I transfer a huge file (over 1T). In this case, Still FDT use a multi-thread? in my case, I cannot get any speed-up. 2) When re-transmit it, It is super-faster than rsync. even if I deleted legacy file that already transferred. Is it cached? or How is it possible?

fixy commented 2 years ago

Hello,

For question 1, it transfers all files by byte range so it does not matter what file size is (almost), you could try to increase threads count by setting parameter -P 20 (to have 20 threads) For question 2, we do not cache data but could you describe more your scenario? If file is already present it could be jus skipped if meta data is same.