Open VictorVerhaert opened 4 weeks ago
Do you have an idea if that ChunkedEncodingError
is just a temp glitch or can you reproduce that failure each time you try to (manually) download the result assets?
We need to make the job manager more robust to these type of exceptions
The question is what can be done better purely at the level of python client implementation.
Skipping the failure with a warning is tempting, but that might not be better (as a default behavior) because the end user might easily overlook that and get wrong impression that everything went fine.
An alternative simple improvement that could help here is add an option to not automatically download results of jobs
While running long jobs using the JobManager, it crashes while trying to download results.
We need to make the job manager more robust to these type of exceptions