Running aws s3 sync [s3 folder with 8 files] [local folder]
and for approx half of the runtime the status doesn't show real numbers of total/remaining files
Expected Behavior
Status shown at the start:
Completed xxx GiB/~yyy GiB (zzz MiB/s) with ~8 file(s) remaining (8 files)
it will be nice to have the ETA shown as Estimated time remaining: [dd] days [hh] hours [mi] minutes [ss] seconds
Current Behavior
While it copies the first 5 files in parallel the status shown is:
Completed xxx GiB/~yyy GiB (zzz MiB/s) with ~5 file(s) remaining (calculating...)
Reproduction Steps
Upload 10 big files (10 GB each) to an s3 folder and run from and ec2 VM:
aws s3 sync [s3 folder] [local folder]
Possible Solution
aws s3 sync should try first scanning for a few seconds all files/subfolders and calculate total number of files and size to quickly display it in the command status.
If scanning takes more than a few seconds then it should start syncing the files/subfolders and display with total (calculating...) file(s) remaining (calculating...) and eventually display the real total/remaining number after if finished scanning the entire folder tree.
Describe the bug
Running
aws s3 sync [s3 folder with 8 files] [local folder]
and for approx half of the runtime the status doesn't show real numbers of total/remaining filesExpected Behavior
Status shown at the start: Completed xxx GiB/~yyy GiB (zzz MiB/s) with ~8 file(s) remaining (8 files)
Estimated time remaining: [dd] days [hh] hours [mi] minutes [ss] seconds
Current Behavior
While it copies the first 5 files in parallel the status shown is: Completed xxx GiB/~yyy GiB (zzz MiB/s) with ~5 file(s) remaining (calculating...)
Reproduction Steps
Upload 10 big files (10 GB each) to an s3 folder and run from and ec2 VM:
aws s3 sync [s3 folder] [local folder]
Possible Solution
aws s3 sync
should try first scanning for a few seconds all files/subfolders and calculate total number of files and size to quickly display it in the command status.If scanning takes more than a few seconds then it should start syncing the files/subfolders and display
with total (calculating...) file(s) remaining (calculating...)
and eventually display the real total/remaining number after if finished scanning the entire folder tree.Additional Information/Context
No response
CLI version used
2.11.25
Environment details (OS name and version, etc.)
Windows Server 2022 Datacenter / Powershell