search

stanfordnmbl / opencap-api

Apache License 2.0
5 stars 6 forks source link

Download not robust #111

Closed antoinefalisse closed 11 months ago

antoinefalisse commented 11 months ago

Users complain that they cannot download their data (the wheel is spinning forever). The celery worker does not seem to be saturating, so I am not sure what the problem is but fixing this should be a priority:

image

I can privately share a session for which it is a problem.

nickbianco commented 11 months ago

@antoinefalisse will discuss with Keenon and @AlbertoCasasOrtiz to discuss potential fixes, might be assign to freelancers.

antoinefalisse commented 11 months ago

Fixed with #115, was not a problem of CPU/Memory but a problem caused by trying to download something from S3 that was not actually existing. This was happening when for instance some trials were missing videos. Added a bunch of try except, and all tests I did worked.