Flaky compatibility regression test (against release-1.1.0)

[real-mj-song]

Issue

Looks like Pinot Compatibility Regression Testing against release-1.1.0 fails transiently. I found multiple PRs where builds are failing for the exact same issue: routing table has not been updated after max wait time.

• https://github.com/apache/pinot/actions/runs/10018304049/job/27693512744
• https://github.com/apache/pinot/actions/runs/10362273763/job/28683991051
• https://github.com/apache/pinot/actions/runs/10361160883/job/28693411672
  • Worked after retrying multiple times
• https://github.com/apache/pinot/actions/runs/10369089362/job/28704062822
• Master build: https://github.com/apache/pinot/actions/runs/10375666483/job/28725839683

Error log 👇🏼

07:23:07.228 INFO [SegmentOp] [main] Successfully verified segment FeatureTest1_Segment5 and its current status is ONLINE.
...
07:25:05.873 WARN [SegmentOp] [main] Routing table has not been updated yet, will retry after 1000 ms.
07:25:06.876 WARN [SegmentOp] [main] Routing table has not been updated yet, will retry after 1000 ms.
07:25:07.879 ERROR [SegmentOp] [main] Upload segment verification failed, routing table has not been updated after max wait time 120000 ms.
07:25:07.886 ERROR [CompatibilityOpsRunner] [main] Failure

[Jackie-Jiang]

This could be related to #9921