pingcap / tidb-operator

TiDB operator creates and manages TiDB clusters running in Kubernetes.
https://docs.pingcap.com/tidb-in-kubernetes/
Apache License 2.0
1.24k stars 499 forks source link

TiKV failure last for 1 minute can cause backup failure [restore for 5294] #5805

Open ti-chi-bot opened 1 month ago

ti-chi-bot commented 1 month ago

Bug Report

What version of Kubernetes are you using? br image:br-flute-ebs-all-6.5:230916142228

What version of TiDB Operator are you using?

What storage classes exist in the Kubernetes cluster and what are used for PD/TiKV pods?

What's the status of the TiDB cluster pods?

What did you do?

  1. do backup
  2. use chaos mesh let tikv failure last for 1 minute

What did you expect to see?

  1. backup will success

What did you see instead?

  1. backup failed 6445b2d6-ddff-4517-9877-10e874be8584
ti-chi-bot commented 1 month ago

This issue is restored for #5294, it originally created at 2023-09-22 02:14:21.