Is your feature request related to a problem? Please describe
Currently we loose the lastAcceptedState and lastAcceptedManifest when a node is bounced. This cause full upload state uploads when cluster manager is elected. This can cause throttling if start uploading too many files to remote store and cause request throttling from remote store.
Describe the solution you'd like
We rebuild the RemotePersistedState object from Remote Store and verify with cluster state object from disk.
andrross
commented
2 weeks ago
Is your feature request related to a problem? Please describe
Currently we loose the lastAcceptedState and lastAcceptedManifest when a node is bounced. This cause full upload state uploads when cluster manager is elected. This can cause throttling if start uploading too many files to remote store and cause request throttling from remote store.
Describe the solution you'd like
We rebuild the RemotePersistedState object from Remote Store and verify with cluster state object from disk.
Related component
Cluster Manager
Describe alternatives you've considered
No response
Additional context
No response