Open jvasile opened 1 year ago
I've made a whole slew of changes that I'm hoping will resolve this and other issues.
Two things may have been happening:
These changes will be deployed this afternoon, at which point I think it would be worth trying this again.
@Fenn-CS, can you keep testing the above and then add your results here?
@jvasile Sure! Would follow up on it.
@Fenn-CS Any word on this? Would love to close it if it isn't repeating.
Uploading a largish (500+ items) directory of largish files (images) and some html files, rclone just hung after 146 files.
The files are all images and web pages from Astronomy Photo Of The Day. I obtained that dir by cloning
https://github.com/OpenTechStrategies/permanent-rclone-qa/
and running./apod-downloader.py
. Then I tried to upload them with./upload-test.py test-tree/apod --remote-dir=apod
. Things went fine, and it zipped along with 4 parallel uploads. But after 146 files, it looks like each upload hung, one by one, as it hit a file that refused to either complete or fail.Here's the log from this run: apod.txt
If you want to reproduce this, you're welcome to use my apod-downloader and upload-test script, but I also suspect you can try to upload just about any largish set of largish files. Maybe I'll try it with a largish set of small files next.
This might be related to #99 but I got way further than just 6 jpgs before things went sideways.