Kimahriman / hdfs-native

Apache License 2.0
32 stars 12 forks source link

Datanode heartbeating #68

Closed Kimahriman closed 10 months ago

Kimahriman commented 10 months ago

Resolves #67

Reworks a lot of the block writer and datanode connection. Split the datanode module into separate block_writer and block_reader modules. Created a separate task for sending the packets, so that the heartbeat task could send packets as well. This should also improve performance a bit by sending packets in the background instead of sending them synchronously during writes.