At first, I get good download speeds (100+ mb/s) and I can download about 10 GB of data before the download hangs for a very long time and my download speed drops to almost 0. If I wait long enough, it will resume, but very quickly go back to the same problem of hanging. If I kill the download and restart, I can download a few more GB of data before this problem occurs again. So I have only been able to incrementally download the dataset via several kills/restarts.
I am downloading the dataset via this command
ego4d --output_directory="~/ego4d_data" --datasets clips annotations --metadataAt first, I get good download speeds (100+ mb/s) and I can download about 10 GB of data before the download hangs for a very long time and my download speed drops to almost 0. If I wait long enough, it will resume, but very quickly go back to the same problem of hanging. If I kill the download and restart, I can download a few more GB of data before this problem occurs again. So I have only been able to incrementally download the dataset via several kills/restarts.
Any reason this might happen?