Race condition from client thinking block is complete before namenode

Rice-Comp413-2016 / RDFS

The Rice Comp413 class (2016-2017) implementation of HDFS. (This will eventually be put under an open source license, which one TBD).

4 stars 2 forks source link

Race condition from client thinking block is complete before namenode #81

Closed pelmers closed 7 years ago

pelmers commented 7 years ago

The data transfer server may complete its final acknowledge before blockReceived returns because acknowledgements are returned on a separate thread.

Then the client thinks its data is complete so it will complete on the namenode, but there is a chance the namenode did not process blockReceived in time and will fail.

pelmers commented 7 years ago

just noticed #80, maybe these could be related?

Vegetable26 commented 7 years ago

This issue is actually an issue with LeaseManager. See https://github.com/Rice-Comp413-2016/RDFS/pull/87