Open JaySon-Huang opened 3 months ago
[APPROVALNOTIFIER] This PR is NOT APPROVED
This pull-request has been approved by: Once this PR has been reviewed and has the lgtm label, please ask for approval from jayson-huang, ensuring that each of them provides their approval before proceeding. For more information see the Code Review Process.
The full list of commands accepted by this bot can be found here.
@JaySon-Huang: The following test failed, say /retest
to rerun all failed tests or /retest-required
to rerun all mandatory failed tests:
Test name | Commit | Details | Required | Rerun command |
---|---|---|---|---|
pull-integration-test | dc52cf9e7b4a78c9e005e4476ddf866d75a34f60 | link | true | /test pull-integration-test |
Full PR test history. Your PR dashboard.
What problem does this PR solve?
Issue Number: ref https://github.com/pingcap/tiflash/issues/8081
Problem Summary: In the previous implementation, the code is kind of messy. We will create a
SSTFilesToBlockInputStream
, thenresetSoftLimit
a soft limit to the input stream.What is changed and how it works?
SnapshotSSTReader
to simplify the code. The following methods moved fromSSTFilesToBlockInputStream
to the new class:getApproxBytes
findSplitKeys
maybeSkipBySoftLimit
maybeStopBySoftLimit
checkFinishedState
SnapshotSSTReader
with given SoftLimit, then use the "SnapshotSSTReader with soft limit" to create "SSTFilesToBlockInputStream"Check List
Tests
Side effects
Documentation
Release note