Send datanode stats periodically to zookeeper

Rice-Comp413-2016 / RDFS

The Rice Comp413 class (2016-2017) implementation of HDFS. (This will eventually be put under an open source license, which one TBD).

4 stars 2 forks source link

Send datanode stats periodically to zookeeper #78

Closed efrederic closed 7 years ago

efrederic commented 7 years ago

We should send stats (number of xmits, available disk space, etc) from the datanode to zookeeper every 3(?) seconds. The stats will be added to the existing DataNodePayload struct in zk_dn_client.h

DataNodePayload fields: uint32_t ipcPort; uint32_t xferPort; uint64_t disk_bytes; //total space on disk uint64_t free_bytes; //free space on disk uint32_t xmits; //current number of xmits

nichhk commented 7 years ago

This issue is a more detailed version of #57

efrederic commented 7 years ago

Nich pointed out an issue already exists. The above info is moving to #57