Waggle Dance fail to respond if one of the metastore becomes unresponsive

ExpediaGroup / waggle-dance

Hive federation service. Enables disparate tables to be concurrently accessed across multiple Hive deployments.

Apache License 2.0

273 stars 76 forks source link

Waggle Dance fail to respond if one of the metastore becomes unresponsive #73

Closed pradeepbhadani closed 6 years ago

pradeepbhadani commented 6 years ago

If I have one Primary Metastore and n federated metastore and one of the metastore stop responding then client connecting to Waggle Dance thrift endpoint gets Thrift Exception and unable to query data/metadata of rest of the metastore.

Additional Info:

WD is running in prefixed mode.

patduin commented 6 years ago

I've added a PR, problem was in the tunneled connections our connection check didn't check the actual metastore was responding at the end of the tunnel