flaky test TestTiKVClientReadTimeout

[hawkingrei]

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

     testkit.go:241: 
            Error Trace:    pkg/testkit/testkit.go:241
                                        pkg/testkit/testkit.go:176
                                        pkg/executor/executor_failpoint_test.go:618
            Error:          Received unexpected error:
                            cannot set read timestamp to a future time
                            github.com/tikv/client-go/v2/oracle/oracles.(*pdOracle).ValidateSnapshotReadTS
                                external/com_github_tikv_client_go_v2/oracle/oracles/pd.go:675
                            github.com/pingcap/tidb/pkg/sessionctx.ValidateSnapshotReadTS
                                pkg/sessionctx/context.go:245
                            github.com/pingcap/tidb/pkg/sessiontxn/staleread.parseAndValidateAsOf
                                pkg/sessiontxn/staleread/processor.go:289
                            github.com/pingcap/tidb/pkg/sessiontxn/staleread.(*staleReadProcessor).OnSelectTable.func1
                                pkg/sessiontxn/staleread/processor.go:172
                            github.com/pingcap/tidb/pkg/sessiontxn/staleread.(*staleReadProcessor).OnSelectTable
                                pkg/sessiontxn/staleread/processor.go:174
                            github.com/pingcap/tidb/pkg/planner/core.(*preprocessor).handleTableName
                                pkg/planner/core/preprocess.go:1606
                            github.com/pingcap/tidb/pkg/planner/core.(*preprocessor).Leave
                                pkg/planner/core/preprocess.go:612
                            github.com/pingcap/tidb/pkg/parser/ast.(*TableName).Accept
                                pkg/parser/ast/dml.go:445
                            github.com/pingcap/tidb/pkg/parser/ast.(*TableSource).Accept
                                pkg/parser/ast/dml.go:601
                            github.com/pingcap/tidb/pkg/parser/ast.(*Join).Accept
                                pkg/parser/ast/dml.go:244
                            github.com/pingcap/tidb/pkg/parser/ast.(*TableRefsClause).Accept
                                pkg/parser/ast/dml.go:824
                            github.com/pingcap/tidb/pkg/parser/ast.(*SelectStmt).Accept
                                pkg/parser/ast/dml.go:1496
                            github.com/pingcap/tidb/pkg/parser/ast.(*ExplainStmt).Accept
                                pkg/parser/ast/misc.go:254
                            github.com/pingcap/tidb/pkg/planner/core.Preprocess
                                pkg/planner/core/preprocess.go:144
                            github.com/pingcap/tidb/pkg/executor.(*Compiler).Compile
                                pkg/executor/compiler.go:69
                            github.com/pingcap/tidb/pkg/session.(*session).ExecuteStmt
                                pkg/session/session.go:2098
                            github.com/pingcap/tidb/pkg/testkit.(*TestKit).ExecWithContext
                                pkg/testkit/testkit.go:425
                            github.com/pingcap/tidb/pkg/testkit.(*TestKit).MustQueryWithContext
                                pkg/testkit/testkit.go:240
                            github.com/pingcap/tidb/pkg/testkit.(*TestKit).MustQuery
                                pkg/testkit/testkit.go:176
                            github.com/pingcap/tidb/pkg/executor_test.TestTiKVClientReadTimeout
                                pkg/executor/executor_failpoint_test.go:618
                            testing.tRunner
                                GOROOT/src/testing/testing.go:1690
                            runtime.goexit
                                src/runtime/asm_amd64.s:1700
                            github.com/pingcap/errors.AddStack
                                external/com_github_pingcap_errors/errors.go:178
                            github.com/pingcap/errors.Trace
                                external/com_github_pingcap_errors/juju_adaptor.go:15
                            github.com/pingcap/tidb/pkg/planner/core.Preprocess
                                pkg/planner/core/preprocess.go:147
                            github.com/pingcap/tidb/pkg/executor.(*Compiler).Compile
                                pkg/executor/compiler.go:69
                            github.com/pingcap/tidb/pkg/session.(*session).ExecuteStmt
                                pkg/session/session.go:2098
                            github.com/pingcap/tidb/pkg/testkit.(*TestKit).ExecWithContext
                                pkg/testkit/testkit.go:425
                            github.com/pingcap/tidb/pkg/testkit.(*TestKit).MustQueryWithContext
                                pkg/testkit/testkit.go:240
                            github.com/pingcap/tidb/pkg/testkit.(*TestKit).MustQuery
                                pkg/testkit/testkit.go:176
                            github.com/pingcap/tidb/pkg/executor_test.TestTiKVClientReadTimeout
                                pkg/executor/executor_failpoint_test.go:618
                            testing.tRunner
                                GOROOT/src/testing/testing.go:1690
                            runtime.goexit
                                src/runtime/asm_amd64.s:1700
            Test:           TestTiKVClientReadTimeout
            Messages:       sql:explain analyze select /*+ set_var(tikv_client_read_timeout=1) */ * from t as of timestamp(@a) where b > 1, args:[] 

2. What did you expect to see? (Required)

3. What did you see instead (Required)

4. What is your TiDB version? (Required)

[hawkingrei]

https://tiprow.hawkingrei.com/view/gs/pingcapprow/pr-logs/pull/pingcap_tidb/57314/fast_test_tiprow/1856615047355174912#1:build-log.txt%3A12865

[cfzjywxk]

Possible related to https://github.com/pingcap/tidb/pull/57050, @MyonKeminta PTAL