search

apache / helix

Mirror of Apache Helix
Apache License 2.0
461 stars 224 forks source link

Apache Pinot facing issues with Helix version 1.4.0 #2850

Open abhioncbr opened 1 month ago

abhioncbr commented 1 month ago

Describe the bug

Apache Pinot is using Helix for various cluster management tasks. I recently tried to upgrade the Helix dependency from 1.3.1 to 1.4.0; however, we are seeing a lot of test failures and startup failures with the newer version of Helix.

Based on the investigation, I pin down the issues because of the change in this PR.

I am trying to understand the change introduced in the PR mentioned above and workaround for the issue. For reference(Apache Pinot Helix upgrade PR)

cc: @jackjlli / @Jackie-Jiang

junkaixue commented 1 month ago

@abhioncbr did Pinot use WAGED rebalance? This WAGED related changes.

Original behavior is when new resource added without partition can cause NPE and break the Helix pipeline. This PR fix this behavior.

adding the author : @himanshukandwal