search

Kimahriman / hdfs-native

Apache License 2.0
32 stars 12 forks source link

Loosen locking around RPC calls for better multi-threading #148

Closed Kimahriman closed 2 weeks ago

Kimahriman commented 2 weeks ago

Resolves #147

Instead of locking around the full RPC call, only lock around creating a new connection and putting the message on the queue for writing.

Adds a benchmark for doing 100 parallel file info calls. Result improved from 6s to 1.5s with these changes.