search

pingcap / tiflash

The analytical engine for TiDB and TiDB Cloud. Try free: https://tidbcloud.com/free-trial
https://docs.pingcap.com/tidb/stable/tiflash-overview
Apache License 2.0
943 stars 410 forks source link

Grpc error after TiFlash restarts for a while #9159

Closed yibin87 closed 3 months ago

yibin87 commented 3 months ago

After https://github.com/pingcap/tidb/pull/53698 which updates several dependecies including grpc from 1.63.2 to 1.64, several tiflash regression test failed constantly due to GRPC error: rpc error: code = DeadlineExceeded desc = received context error while waiting for new LB policy update: context deadline exceeded rpc error: code = Unavailable desc = connection error: desc = \\"transport: Error while dialing: dial tcp 10.200.86.26:3930: i/o timeout

These errors always happen after TiFlash retarts for a while.

JaySon-Huang commented 3 months ago

@yibin87 Can we close this issue?

yibin87 commented 3 months ago

Yeah, fix already.

ekexium commented 3 months ago

Will this issue block us from upgrading grpc forever?

yibin87 commented 3 months ago

Will this issue block us from upgrading grpc forever?

Next time we want to upgrade client-go grpc version, we need to analyze and resolve this tiflash issue first.