openebs-archive / cstor-operators

Collection of OpenEBS cStor Data Engine Operators
https://openebs.io
Apache License 2.0
94 stars 69 forks source link

cstor-disk-pool pod CrashLoopBackOff #425

Open ariesliuwei opened 2 years ago

ariesliuwei commented 2 years ago

cstor-disk-pool pod CrashLoopBackOff

environment information operating system:centos architecture: arm64 openebs cstor version: v3.2.0

install openebs cstor

cspc1

lsblk -fa, check before create cspc

cspc3

get blockdevices

cspc5

get cspc and cspi after cspc created

cspc7

cspc6

get cstor-disk-pool pod

cspc2

cspc8

Check cstor-disk-pool log , errors the following

I0517 13:44:18.367125 7 event.go:282] Event(v1.ObjectReference{Kind:"CStorPoolInstance", Namespace:"kube-system", Name:"cstor-disk-pool-6xbw", UID:"2d48a63a-ec38-4485-93b2-e328b914afd8", APIVersion:"cstor.openebs.io/v1", ResourceVersion:"310926", FieldPath:""}): type: 'Warning' reason: 'FailedSync' Failed to import the pool as the underlying pool might be lost or the disk(s) has gone bad I0517 13:44:48.158419 7 event.go:282] Event(v1.ObjectReference{Kind:"CStorVolumeReplica", Namespace:"kube-system", Name:"pvc-e9cd8580-1347-4d42-a590-a6b632433b42-cstor-disk-pool-6xbw", UID:"ce186f69-5372-4085-9b8e-956dc8da4800", APIVersion:"cstor.openebs.io/v1", ResourceVersion:"308783", FieldPath:""}): type: 'Normal' reason: 'Synced' Received Resource destroy event I0517 13:44:48.198818 7 import.go:73] Importing pool 2d48a63a-ec38-4485-93b2-e328b914afd8 cstor-4409b1b8-31fd-42d5-8c46-9082b78d3c5f E0517 13:44:48.204552 7 import.go:94] Failed to import pool by reading cache file: failed to initialize libuzfs client : exit status 1 E0517 13:44:48.212170 7 import.go:114] Failed to import pool by scanning directory: failed to initialize libuzfs client : exit status 1 I0517 13:44:48.212409 7 event.go:282] Event(v1.ObjectReference{Kind:"CStorPoolInstance", Namespace:"kube-system", Name:"cstor-disk-pool-6xbw", UID:"2d48a63a-ec38-4485-93b2-e328b914afd8", APIVersion:"cstor.openebs.io/v1", ResourceVersion:"310926", FieldPath:""}): type: 'Warning' reason: 'FailedSync' Failed to import the pool as the underlying pool might be lost or the disk(s) has gone bad I0517 13:44:48.241048 7 import.go:73] Importing pool 2d48a63a-ec38-4485-93b2-e328b914afd8 cstor-4409b1b8-31fd-42d5-8c46-9082b78d3c5f E0517 13:44:48.247012 7 import.go:94] Failed to import pool by reading cache file: failed to initialize libuzfs client : exit status 1 E0517 13:44:48.252526 7 import.go:114] Failed to import pool by scanning directory: failed to initialize libuzfs client : exit status 1 I0517 13:44:48.253465 7 event.go:282] Event(v1.ObjectReference{Kind:"CStorPoolInstance", Namespace:"kube-system", Name:"cstor-disk-pool-6xbw", UID:"2d48a63a-ec38-4485-93b2-e328b914afd8", APIVersion:"cstor.openebs.io/v1", ResourceVersion:"311046", FieldPath:""}): type: 'Warning' reason: 'FailedSync' Failed to import the pool as the underlying pool might be lost or the disk(s) has gone bad I0517 13:45:18.158460 7 event.go:282] Event(v1.ObjectReference{Kind:"CStorVolumeReplica", Namespace:"kube-system", Name:"pvc-e9cd8580-1347-4d42-a590-a6b632433b42-cstor-disk-pool-6xbw", UID:"ce186f69-5372-4085-9b8e-956dc8da4800", APIVersion:"cstor.openebs.io/v1", ResourceVersion:"308783", FieldPath:""}): type: 'Normal' reason: 'Synced' Received Resource destroy event I0517 13:45:18.196632 7 import.go:73] Importing pool 2d48a63a-ec38-4485-93b2-e328b914afd8 cstor-4409b1b8-31fd-42d5-8c46-9082b78d3c5f E0517 13:45:18.202255 7 import.go:94] Failed to import pool by reading cache file: failed to initialize libuzfs client : exit status 1 E0517 13:45:18.207268 7 import.go:114] Failed to import pool by scanning directory: failed to initialize libuzfs client : exit status 1 I0517 13:45:18.207597 7 event.go:282] Event(v1.ObjectReference{Kind:"CStorPoolInstance", Namespace:"kube-system", Name:"cstor-disk-pool-6xbw", UID:"2d48a63a-ec38-4485-93b2-e328b914afd8", APIVersion:"cstor.openebs.io/v1", ResourceVersion:"311046", FieldPath:""}): type: 'Warning' reason: 'FailedSync' Failed to import the pool as the underlying pool might be lost or the disk(s) has gone bad I0517 13:45:18.250481 7 import.go:73] Importing pool 2d48a63a-ec38-4485-93b2-e328b914afd8 cstor-4409b1b8-31fd-42d5-8c46-9082b78d3c5f E0517 13:45:18.266530 7 import.go:94] Failed to import pool by reading cache file: failed to initialize libuzfs client : exit status 1 E0517 13:45:18.274104 7 import.go:114] Failed to import pool by scanning directory: failed to initialize libuzfs client : exit status 1 I0517 13:45:18.274344 7 event.go:282] Event(v1.ObjectReference{Kind:"CStorPoolInstance", Namespace:"kube-system", Name:"cstor-disk-pool-6xbw", UID:"2d48a63a-ec38-4485-93b2-e328b914afd8", APIVersion:"cstor.openebs.io/v1", ResourceVersion:"311165", FieldPath:""}): type: 'Warning' reason: 'FailedSync' Failed to import the pool as the underlying pool might be lost or the disk(s) has gone bad

lsblk -fa, check after create cspc.

FSTYPE became zfs_member, which is empty before create cspc.

cspc10

Mrwu87 commented 2 years ago

Help......have you solved it??

tidux commented 7 months ago

This is still broken nearly two years later on RH family distros (Fedora 39).

FloatingLikeDust commented 1 month ago

are u resolve this problem