search

Intel-bigdata / SSM

Smart Storage Management for Big Data, a comprehensive hot/cold data optimized solution
Apache License 2.0
134 stars 67 forks source link

Optimize report delivery from client to active smart server in HA mode #2229

Closed PHILO-HE closed 3 years ago

PHILO-HE commented 3 years ago

I just added another solution. The report will be delivered to multiple smart servers simultaneously. And if one report task is successfully executed, other tasks will be canceled. This will be a default strategy. If user would like to fallback to previous one-by-one trying strategy, a property (see code) needs to be set to false in configuration on client side (HBase, Spark, etc).

PHILO-HE commented 3 years ago

This new solution should also work well on windows environment. For one-by-one trying strategy with local file to maintain active server, windows support may take few effort. @lipppppp, you can try to do that support by yourself and then port it to your customer's windows environment.