search

qubole / rubix

Cache File System optimized for columnar formats and object stores
Apache License 2.0
182 stars 74 forks source link

ClusterManager refactoring and adding ability to provide custom hostname by ClusterManager implementations #437

Closed shubhamtagra closed 4 years ago

shubhamtagra commented 4 years ago

Main changes:

  1. Offload all cluster related management like node-list, currentNodeIndex from BookKeeper to ClusterManager class
  2. Simplifies implementation of ClusterManager by moving node-list caching into common place in ClusterManager
  3. Adds logic to let ClusterManager implementations provide custom hostname/hostAddress to find currentNodeIndex. This fixes #436 as PrestoClusterManager will now return hostname and hostAddress that is registered with NodeManager