Zarquan
commented
3 years ago In particular, if they are on separate volumes, then they will show up as separate items in the Prometius metrics, making it easier to monitor their use over time.
At the moment Cinder volumes don't show up in Prometheus metrics #496
The current deployment, PR #418, puts all three sets of temp files onto the same Cinder volume, making it hard to see how much space each one is using.
This task is to separate the HDFS data, Hadoop temp and Spark temp directories onto separate Cinder volumes so that we can measure the performance and use more easily.
In particular, if they are on separate volumes, then they will show up as separate items in the Prometius metrics, making it easier to monitor their use over time.