search

pingcap / tidb-operator

TiDB operator creates and manages TiDB clusters running in Kubernetes.
https://docs.pingcap.com/tidb-in-kubernetes/
Apache License 2.0
1.23k stars 498 forks source link

TiKV failed for more than 5 minutes, and the system did not set the backup task as failed [restore for 5439] #5812

Open ti-chi-bot opened 3 hours ago

ti-chi-bot commented 3 hours ago

Bug Report

What version of Kubernetes are you using?

What version of TiDB Operator are you using?

What storage classes exist in the Kubernetes cluster and what are used for PD/TiKV pods?

What's the status of the TiDB cluster pods?

What did you do?

  1. let TiKV failed for more than 5 minutes,
  2. do volumebackup

What did you expect to see?

  1. if br can not connect tikv for more than 5 minutes, backup task should be set failed

What did you see instead?

  1. br always retrying img_v3_025q_30f8114c-54c1-4f3a-809a-986f46fba11g img_v3_025q_b371bbfe-b01a-4434-8a75-209f1909512g
ti-chi-bot commented 3 hours ago

This issue is restored for #5439, it originally created at 2023-12-04 07:48:34.