Azure / aztk

AZTK powered by Azure Batch: On-demand, Dockerized, Spark Jobs on Azure
MIT License
150 stars 66 forks source link

jupyter metastore #141

Open jiata opened 6 years ago

jiata commented 6 years ago

the default on jupyter is to have the metastore created on the node – this might be a problem to retain metadata since the storage is ephemeral image

paselem commented 6 years ago

Possibly worth investigating azure files for this. What all is stored in the metastore_db?

jafreck commented 6 years ago

@jiata Is this still an issue?