Kimahriman / hdfs-native

Apache License 2.0
32 stars 12 forks source link

Support DataNode connection caching #79

Closed Kimahriman closed 9 months ago

Kimahriman commented 9 months ago

As a performance improvement, we should support caching and reusing datanode connections like the Java library does. This reduces the overhead of creating a new TCP connection for every individual block read to the same datanode