Closed ti-chi-bot closed 1 year ago
[REVIEW NOTIFICATION]
This pull request has been approved by:
To complete the pull request process, please ask the reviewers in the list to review by filling /cc @reviewer
in the comment.
After your PR has acquired the required number of LGTMs, you can assign this pull request to the committer in the list by filling /assign @committer
in the comment to help you merge this pull request.
The full list of commands accepted by this bot can be found here.
/run-all-tests
/run-all-tests
/run-all-tests
/run-all-tests
/merge
This pull request has been accepted and is ready to merge.
This is an automated cherry-pick of #2667
What problem does this PR solve?
TiSpark will reload all table schemas when init catalogCache. It will also reload all table schemas once we call listTable or getTable with the invalid cache.
One user reports that TiSpark hangs with more than 10000+ table schemas.
What is changed and how it works?
Add a configuration
spark.tispark.load_tables
, default is true. when set it to false, we will not load all tables when we reload the cache. table cache will only be loaded when the table is used.Check List
Tests