Rice-Comp413-2016 / RDFS

The Rice Comp413 class (2016-2017) implementation of HDFS. (This will eventually be put under an open source license, which one TBD).
4 stars 2 forks source link

Generalize DataNode-to-DataNode data packet streaming #44

Open jfking opened 8 years ago

jfking commented 8 years ago

DataNodes need the ability to send data packets between themselves. We have most of the machinery in place in data_transfer_server.cc, but it needs to be generalized to allow pipelining of blocks. This will also be necessary once NameNode-commanded replication is being implemented.