Intel-bigdata / Spark-PMoF

Spark Shuffle Optimization with RDMA+AEP
Apache License 2.0
30 stars 22 forks source link

Add metastore service and heartbeat module among proxy and nodes #101

Closed Eugene-Mark closed 3 years ago

Eugene-Mark commented 3 years ago

Add metastore service using Redis, JsonCpp is introduced to manage a list of objects. Add heatbeat module among proxy and nodes, the node status is persisted to metastore backend.