Scanning and diffing takes a long time for large directories

google / adb-sync

Apache License 2.0

1.08k stars 169 forks source link

Scanning and diffing takes a long time for large directories #55

Open wcerfgba opened 3 years ago

wcerfgba commented 3 years ago

Hi,

I am trying to copy a large folder (several GiB with many thousands of files) and I'm stuck on INFO:root:Scanning and diffing... for a long time. Is there a way I can skip this and just delete/overwrite files by name?

Thanks!

freemedom commented 6 months ago

What does "just delete/overwrite files by name" mean?

freemedom commented 6 months ago

I have found that when there are a large number of small files, PerformCopies pull files take much longer than ScanAndDiff. 20,000 files would take about two or three hours.