search

Rice-Comp413-2016 / RDFS

The Rice Comp413 class (2016-2017) implementation of HDFS. (This will eventually be put under an open source license, which one TBD).
4 stars 2 forks source link

Implement data replication between DataNodes #45

Open jfking opened 8 years ago

jfking commented 8 years ago

Builds on #44. The NameNode can command DataNodes to send blocks to other DataNodes for the purposes of block recovery and rebalancing. Once the machinery for general data packet streaming between DataNodes is in place, we'll want to add in logic for DataNodes to respond to these requests from the NameNode and initiate streaming.

nichhk commented 7 years ago

@srdieffenbach will be implementing this for the Replication milestone.

nichhk commented 7 years ago

@Swyrough will be helping with protobuf things.

srdieffenbach commented 7 years ago

On branch repl-inter-datanode.