tom-james-watson / dat-cp

dcp | Dat Copy - remote file copy, powered by the Dat protocol

MIT License

315 stars 21 forks source link

large file create metadata is too slow #21

Open freedba opened 5 years ago

freedba commented 5 years ago

./dcp -v ../guest.vdi

dcp DEBUG Creating dat archive. dcp DEBUG Connecting to dat network. dcp DEBUG Creating metadata for files: guest.vdi [=======---------------------------------] 17% | 8m14s | 5.05/29.46GB

creating metadata for large files ,it is too slow, how optimize ? Thanks !!

tom-james-watson commented 5 years ago

Unfortunately it's necessary to scan the entire file in order to create the needed metadata for transfer, and obviously for very large files this can take a while.

freedba commented 5 years ago

Thank you ,Can you add the speed limit function?

tom-james-watson commented 5 years ago

What do you mean exactly?