The PR introduced the InflightReadsLimiter, the exchange replicator will read data and route index data to the queue topic, but it doesn't release the EntryImpl object, this will cause the broker in-flight read cache limiter to be exhausted.
Modifications
Release EntryImpl object while reading the exchange topic.
Use topic dispatch limiter to control read batch size.
Verifying this change
Add test to verify the in-flight read cache can't be exhausted.
Does this pull request potentially affect one of the following parts:
Documentation
Check the box below.
Need to update docs?
[ ] doc-required
(If you need help on updating docs, create a doc issue)
Motivation
The PR introduced the InflightReadsLimiter, the exchange replicator will read data and route index data to the queue topic, but it doesn't release the EntryImpl object, this will cause the broker in-flight read cache limiter to be exhausted.
Modifications
Release
EntryImpl
object while reading the exchange topic. Use topic dispatch limiter to control read batch size.Verifying this change
Add test to verify the in-flight read cache can't be exhausted.
Does this pull request potentially affect one of the following parts:
Documentation
Check the box below.
Need to update docs?
[ ]
doc-required
(If you need help on updating docs, create a doc issue)
[x]
no-need-doc
(Please explain why)
[ ]
doc
(If this PR contains doc changes)