Closed ghukill closed 5 years ago
While importing to Mongo and ElasticSearch via Spark, update status of Jobs in GUI to importing
. This might be a special status that will rely on bg task to update, not the normal Job.update_status()
, as that cannot be aware of background spark processes.
Done.
Once GUI and DB models are in place, will want to run these export/imports as background (celery) tasks.