equalitie / open-corroborator

Data analysis and fact corroboration
http://equalitie.github.io/open-corroborator/
7 stars 3 forks source link

With S3 storage, initial GET is too soon #16

Open ggaughan opened 8 years ago

ggaughan commented 8 years ago

After an initial media upload to S3, the initial GET is too soon and leads to a 404 before S3 is ready (when queued at least). For local (non-S3) storage the timing mostly seems to work on the machines I've tried it on.

I think django-queued storages has a feature where it serves from local disk if not (yet) on S3 but that doesn't appear to be being used.

ggaughan commented 8 years ago

Since queued-storages' main benefit isn't being used, and since the version for Django 1.8 seems out of date (it relies on django-celery which is deprecated) - I suggest removing it and just using S3 storage directly. The Celery queue would still be needed for Solr updates, but django-celery could be removed.