MI-DPLA / combine

Combine /kämˌbīn/ - Metadata Aggregator Platform
MIT License
26 stars 11 forks source link

stateio: run exports / imports as bg task #338

Closed ghukill closed 5 years ago

ghukill commented 5 years ago

Once GUI and DB models are in place, will want to run these export/imports as background (celery) tasks.

ghukill commented 5 years ago

While importing to Mongo and ElasticSearch via Spark, update status of Jobs in GUI to importing. This might be a special status that will rely on bg task to update, not the normal Job.update_status(), as that cannot be aware of background spark processes.

ghukill commented 5 years ago

Done.