What if a disk or node fails ?

[luckydogxf]

kubectl directpv drives ls

/dev/dm-1 3.9 GiB 3.9 GiB linux-swap - k8s-node-2 - Available /dev/sdb 24 GiB 8.4 GiB xfs 1 k8s-node-2 - Terminating /dev/sdc 24 GiB 8.4 GiB xfs 1 k8s-node-2 - Terminating /dev/sdd 24 GiB 8.4 GiB xfs 1 k8s-node-2 - Terminating

Hello, my node k8s-node-2 fails, not it's status it is stuck in Terminating, how to force release it and format it again?

Or what's the right step when disks or nodes fail ?

Thanks.

[luckydogxf]

Interesting, after a long period, few duplicate devices were created with state 'available'. /dev/dm-1 3.9 GiB 3.9 GiB linux-swap - k8s-node-2 - Available /dev/sdb 24 GiB 8.4 GiB xfs 1 k8s-node-2 - Terminating /dev/sdb 24 GiB 8.4 GiB xfs 1 k8s-node-2 - Available ...... and sbc/sdd have duplicated device, too.

[Praveenrajmani]

you can refer https://github.com/minio/directpv/blob/master/docs/troubleshooting.md#cleaning-up-abandoned-volumes-from-a-terminating-drive to clean up terminating drives @luckydogxf

[Praveenrajmani]

what is the directpv version used here? @luckydogxf

was --enable-dynamic-discovery set during installation?

[Praveenrajmani]

can you share us the output of the following commands as well?

kubectl directpv drives ls --all -o yaml > /tmp/drives.yaml
kubectl directpv volumes ls --all -o yaml > /tmp/volumes.yaml

and paste these two files here

[luckydogxf]

okay, thanks. I'll try to reproduce it later. Now I have to resolve another issue.

[luckydogxf]

Now I reinstall my kubernetes ,minio operator and directpv.

PVC is stucking forever when I create a teanat. Here is the event.

3m39s Warning ProvisioningFailed persistentvolumeclaim/0-hongquan-ss-0-0 failed to provision volume with StorageClass "direct-csi-min-io": rpc err or: code = ResourceExhausted desc = no drive found for requested topology-

My envionment :

kubectl directpv drives ls

/dev/sdc 24 GiB 44 MiB xfs - k8s-master-1 - Ready /dev/sdd 24 GiB 44 MiB xfs - k8s-master-1 - Ready /dev/sde 24 GiB 44 MiB xfs - k8s-master-1 - Ready /dev/sdf 24 GiB 44 MiB xfs - k8s-master-1 - Ready /dev/sdc 24 GiB 44 MiB xfs - k8s-master-2 - Ready /dev/sdd 24 GiB 44 MiB xfs - k8s-master-2 - Ready /dev/sde 24 GiB 44 MiB xfs - k8s-master-2 - Ready /dev/sdf 24 GiB 44 MiB xfs - k8s-master-2 - Ready /dev/sdc 24 GiB 44 MiB xfs - k8s-node-1 - Ready /dev/sdd 24 GiB 44 MiB xfs - k8s-node-1 - Ready /dev/sde 24 GiB 44 MiB xfs - k8s-node-1 - Ready /dev/sdf 24 GiB 44 MiB xfs - k8s-node-1 - Ready /dev/sdg 24 GiB 44 MiB xfs - k8s-node-1 - Ready /dev/sdc 24 GiB 44 MiB xfs - k8s-node-2 - Ready /dev/sdd 24 GiB 44 MiB xfs - k8s-node-2 - Ready /dev/sde 24 GiB 44 MiB xfs - k8s-node-2 - Ready /dev/sdf 24 GiB 44 MiB xfs - k8s-node-2 - Ready /dev/sdg 24 GiB 44 MiB xfs - k8s-node-2 - Ready

kubectl directpv info NODE CAPACITY ALLOCATED VOLUMES DRIVES k8s-master-1 96 GiB 0 B 0 4 k8s-master-2 96 GiB 0 B 0 4 k8s-node-1 120 GiB 0 B 0 5 k8s-node-2 120 GiB 0 B 0 5

As you can see, I have four servers, two of them have 4 disks ,while the rest two have 5 disks. I create a 4 server with 16 volumes( 2 volumes for log/... as indicated in documentation). It's stuck in pvc creating. The error is 'no drive found for requested topology'

[Praveenrajmani]

as the error says, the topology requirements did not match. can you describe the PVC? @luckydogxf

[luckydogxf]

• kubectl get pvc NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS AGE 0-hongquan-ss-0-0 Pending direct-csi-min-io 31m 0-hongquan-ss-0-1 Pending direct-csi-min-io 31m 0-hongquan-ss-0-2 Pending direct-csi-min-io 31m 0-hongquan-ss-0-3 Pending direct-csi-min-io 31m 1-hongquan-ss-0-0 Pending direct-csi-min-io 31m 1-hongquan-ss-0-1 Pending direct-csi-min-io 31m 1-hongquan-ss-0-2 Pending direct-csi-min-io 31m 1-hongquan-ss-0-3 Pending direct-csi-min-io 31m 2-hongquan-ss-0-0 Pending direct-csi-min-io 31m 2-hongquan-ss-0-1 Pending direct-csi-min-io 31m 2-hongquan-ss-0-2 Pending direct-csi-min-io 31m 2-hongquan-ss-0-3 Pending direct-csi-min-io 31m 3-hongquan-ss-0-0 Pending direct-csi-min-io 31m 3-hongquan-ss-0-1 Pending direct-csi-min-io 31m 3-hongquan-ss-0-2 Pending direct-csi-min-io 31m 3-hongquan-ss-0-3 Pending direct-csi-min-io 31m

just find that seems size does not meet the requirement. I have 16 x 24G = 384G in all, yet when I create a tenant with the following command line kubectl minio tenant create hongquan --servers 4 --volumes 16 --capacity 384Gi -n default -s direct-csi-min-io It hangs. But everthing is fine when I change the size to 288G. Why I cannot use the entire size? kubect directpv drives ls shows that 44Mi has been allocated, is it related? @Praveenrajmani

[luckydogxf]

I removed the last disk and replace a new one, and I followed the troubleshoot page and delete failed pv and pvc accordingly. PV and PVC were deleted, too.

 /dev/sdf   24 GiB    24 GiB     -            -        k8s-master-1  -            Available
 /dev/sdf   24 GiB    24 GiB     xfs          1        k8s-master-1  -            Terminating

However kubectl directpv drive ls still shows terminating state.

kubectl-directpv --version directpv version v2.0.1 and --enable-dynamic-discovery was enabled, too.

[luckydogxf]

[root@k8s-master-1 ~]# cat /tmp/drives.yaml
apiVersion: direct.csi.min.io/v1beta3
items:
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:50:53Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/path: dm-0
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:dmName: {}
          f:dmUUID: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:mountOptions: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:virtual: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:50:53Z"
    name: b1146860-ebfb-4550-93f8-2bdcc9ac7469
    resourceVersion: "2116"
    uid: 5a7a7e1c-55cf-414f-b319-5c161386f717
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 53687091200
    conditions:
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: /
      reason: NotAdded
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    dmName: centos_k8s--master--1-root
    dmUUID: LVM-cH5cf5Q7nERQFiTNe2Z0QQmFdOPfrWw6pthH1nNnp7MkVb5S5YHMkFfRY6Qt89HI
    driveStatus: Unavailable
    filesystem: xfs
    filesystemUUID: c9bb2751-3873-4f8f-85ab-a79caf04b451
    logicalBlockSize: 512
    majorNumber: 253
    mountOptions:
    - relatime
    - rw
    mountpoint: /
    nodeName: k8s-master-1
    path: /dev/dm-0
    physicalBlockSize: 512
    rootPartition: dm-0
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 53687091200
    ueventFSUUID: c9bb2751-3873-4f8f-85ab-a79caf04b451
    virtual: true
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:50:53Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/path: dm-1
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:dmName: {}
          f:dmUUID: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:virtual: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:50:53Z"
    name: 367df209-0767-4943-83df-939220926a8b
    resourceVersion: "2120"
    uid: 8a0b97ae-4e3b-4c74-9236-2904ba67ef39
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 8455716864
    conditions:
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    dmName: centos_k8s--master--1-swap
    dmUUID: LVM-cH5cf5Q7nERQFiTNe2Z0QQmFdOPfrWw6gJU3kNvL1nLbhW9B49FcfAsR1fthJipv
    driveStatus: Available
    filesystem: swap
    filesystemUUID: 2c09ca8f-2dbc-4545-88aa-0f5ac80aced7
    logicalBlockSize: 512
    majorNumber: 253
    minorNumber: 1
    nodeName: k8s-master-1
    path: /dev/dm-1
    physicalBlockSize: 4096
    rootPartition: dm-1
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 8455716864
    ueventFSUUID: 2c09ca8f-2dbc-4545-88aa-0f5ac80aced7
    virtual: true
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:50:53Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/path: dm-2
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:dmName: {}
          f:dmUUID: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:mountOptions: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:virtual: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:50:53Z"
    name: fe36e059-cd70-4886-8d02-3d101cc9bbcd
    resourceVersion: "2105"
    uid: 830d0add-545d-4a4a-a4ed-97826b60506e
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 65624080384
    conditions:
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: /home
      reason: NotAdded
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    dmName: centos_k8s--master--1-home
    dmUUID: LVM-cH5cf5Q7nERQFiTNe2Z0QQmFdOPfrWw6DBOFc4u3owvktugkf5eb94szCDJ3b1Wp
    driveStatus: Unavailable
    filesystem: xfs
    filesystemUUID: 00c2ab20-c0b5-4c21-8d74-629879d60472
    logicalBlockSize: 512
    majorNumber: 253
    minorNumber: 2
    mountOptions:
    - relatime
    - rw
    mountpoint: /home
    nodeName: k8s-master-1
    path: /dev/dm-2
    physicalBlockSize: 512
    rootPartition: dm-2
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 65624080384
    ueventFSUUID: 00c2ab20-c0b5-4c21-8d74-629879d60472
    virtual: true
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:50:53Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/path: sda
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:modelNumber: {}
          f:nodeName: {}
          f:partTableType: {}
          f:partitioned: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:50:53Z"
    name: bc2375c5-59a9-416e-800e-6c5b16a56a42
    resourceVersion: "2112"
    uid: c0b9e1a0-10f5-4984-ab3e-451fb9e7f2bc
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 128849018880
    conditions:
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: xfs
      reason: NotAdded
      status: "False"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Unavailable
    logicalBlockSize: 512
    majorNumber: 8
    modelNumber: Virtual_disk
    nodeName: k8s-master-1
    partTableType: dos
    partitioned: true
    path: /dev/sda
    physicalBlockSize: 4096
    rootPartition: sda
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 128849018880
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:50:53Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/path: sda1
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountOptions: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:partTableType: {}
          f:partitionNum: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:50:53Z"
    name: 93c9c371-e3d3-4a98-8d0f-bdbf22a46045
    resourceVersion: "2108"
    uid: 12156c21-77e6-4dfe-9b33-3e56cbe9ae03
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 1073741824
    conditions:
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: /boot
      reason: NotAdded
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Unavailable
    filesystem: xfs
    filesystemUUID: 6cee82d0-5f3d-4cdd-acb4-b24ab6bc1709
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 1
    modelNumber: Virtual_disk
    mountOptions:
    - relatime
    - rw
    mountpoint: /boot
    nodeName: k8s-master-1
    partTableType: dos
    partitionNum: 1
    path: /dev/sda1
    physicalBlockSize: 512
    rootPartition: sda1
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 1073741824
    ueventFSUUID: 6cee82d0-5f3d-4cdd-acb4-b24ab6bc1709
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:50:53Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/path: sda2
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:master: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:nodeName: {}
          f:partTableType: {}
          f:partitionNum: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:50:53Z"
    name: 2beff92b-1357-4236-b188-7f19903aa00f
    resourceVersion: "2111"
    uid: 6fada7d2-2fc8-45b9-b982-9897f88f4300
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 127774228480
    conditions:
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Unavailable
    filesystem: LVM2_member
    filesystemUUID: 32888L-m1zS-cRsE-LvF9-Xffq-b1NR-wWIpUt
    logicalBlockSize: 512
    majorNumber: 8
    master: dm-2
    minorNumber: 2
    modelNumber: Virtual_disk
    nodeName: k8s-master-1
    partTableType: dos
    partitionNum: 2
    path: /dev/sda2
    physicalBlockSize: 4096
    rootPartition: sda2
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 127774228480
    ueventFSUUID: 32888L-m1zS-cRsE-LvF9-Xffq-b1NR-wWIpUt
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:50:53Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/path: sdb
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:50:53Z"
    name: bc5a78a2-0e65-49bd-a6d8-6e4fa527ed45
    resourceVersion: "2117"
    uid: 4fe18aa9-0693-4f88-bdd1-2022174f36ff
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 25769803776
    conditions:
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Available
    filesystem: xfs
    filesystemUUID: a8c08f52-3205-4f6f-b947-e48798c2124f
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 16
    modelNumber: Virtual_disk
    nodeName: k8s-master-1
    path: /dev/sdb
    physicalBlockSize: 4096
    rootPartition: sdb
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 25769803776
    ueventFSUUID: a8c08f52-3205-4f6f-b947-e48798c2124f
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:50:53Z"
    finalizers:
    - direct.csi.min.io/data-protection
    - direct.csi.min.io.volume/pvc-bce70e31-43b8-4192-ba99-438280b5a5a7
    generation: 9
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/path: sdc
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:spec:
          f:directCSIOwned: {}
      manager: kubectl-directpv
      operation: Update
      time: "2022-01-13T03:54:09Z"
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io.volume/pvc-bce70e31-43b8-4192-ba99-438280b5a5a7": {}
            v:"direct.csi.min.io/data-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:freeCapacity: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountOptions: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T06:22:19Z"
    name: 0ebe5360-98d4-4172-a52e-7a4290608236
    resourceVersion: "46249"
    uid: 7e960ebf-7ada-4b15-8564-48a4ee390ba5
  spec:
    directCSIOwned: true
  status:
    accessTier: Unknown
    allocatedCapacity: 25212211200
    conditions:
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: ""
      reason: Added
      status: "True"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: Mounted
      reason: Added
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: Formatted
      reason: Added
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: InUse
    filesystem: xfs
    filesystemUUID: f3f941a1-8604-4098-8b4b-48c46c8e2be9
    freeCapacity: 557592576
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 32
    modelNumber: Virtual_disk
    mountOptions:
    - relatime
    - rw
    mountpoint: /var/lib/direct-csi/mnt/f3f941a1-8604-4098-8b4b-48c46c8e2be9
    nodeName: k8s-master-1
    path: /dev/sdc
    physicalBlockSize: 512
    rootPartition: sdc
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 25769803776
    ueventFSUUID: f3f941a1-8604-4098-8b4b-48c46c8e2be9
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:50:53Z"
    finalizers:
    - direct.csi.min.io/data-protection
    - direct.csi.min.io.volume/pvc-6503f872-1e0a-47f2-9bf5-fc94e11ca56f
    generation: 9
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/path: sdd
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:spec:
          f:directCSIOwned: {}
      manager: kubectl-directpv
      operation: Update
      time: "2022-01-13T03:54:09Z"
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io.volume/pvc-6503f872-1e0a-47f2-9bf5-fc94e11ca56f": {}
            v:"direct.csi.min.io/data-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:freeCapacity: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountOptions: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T06:22:19Z"
    name: 4ea9d319-c57e-418a-9629-cc7b60e47be0
    resourceVersion: "46251"
    uid: 3ae1bd85-794c-4663-88a1-e9b1770f1dd1
  spec:
    directCSIOwned: true
  status:
    accessTier: Unknown
    allocatedCapacity: 25212211200
    conditions:
    - lastTransitionTime: "2022-01-13T03:54:09Z"
      message: ""
      reason: Added
      status: "True"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:54:09Z"
      message: Mounted
      reason: Added
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:54:09Z"
      message: Formatted
      reason: Added
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: InUse
    filesystem: xfs
    filesystemUUID: 31101234-624e-45bb-9896-86819961fa3e
    freeCapacity: 557592576
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 48
    modelNumber: Virtual_disk
    mountOptions:
    - relatime
    - rw
    mountpoint: /var/lib/direct-csi/mnt/31101234-624e-45bb-9896-86819961fa3e
    nodeName: k8s-master-1
    path: /dev/sdd
    physicalBlockSize: 512
    rootPartition: sdd
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 25769803776
    ueventFSUUID: 31101234-624e-45bb-9896-86819961fa3e
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:50:53Z"
    finalizers:
    - direct.csi.min.io/data-protection
    - direct.csi.min.io.volume/pvc-56674d48-bcd3-4369-9874-a864f3628b2b
    generation: 9
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/path: sde
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:spec:
          f:directCSIOwned: {}
      manager: kubectl-directpv
      operation: Update
      time: "2022-01-13T03:54:09Z"
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io.volume/pvc-56674d48-bcd3-4369-9874-a864f3628b2b": {}
            v:"direct.csi.min.io/data-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:freeCapacity: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountOptions: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T06:22:19Z"
    name: 377ed223-51db-4362-802f-81c93f3ef5c3
    resourceVersion: "46250"
    uid: a7e2293c-aea1-42b6-ac3f-bc476f9a5be9
  spec:
    directCSIOwned: true
  status:
    accessTier: Unknown
    allocatedCapacity: 25212211200
    conditions:
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: ""
      reason: Added
      status: "True"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: Mounted
      reason: Added
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: Formatted
      reason: Added
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: InUse
    filesystem: xfs
    filesystemUUID: 29652ee5-11f7-400f-a3fe-7032eadae2b8
    freeCapacity: 557592576
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 64
    modelNumber: Virtual_disk
    mountOptions:
    - relatime
    - rw
    mountpoint: /var/lib/direct-csi/mnt/29652ee5-11f7-400f-a3fe-7032eadae2b8
    nodeName: k8s-master-1
    path: /dev/sde
    physicalBlockSize: 512
    rootPartition: sde
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 25769803776
    ueventFSUUID: 29652ee5-11f7-400f-a3fe-7032eadae2b8
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T06:22:05Z"
    generation: 3
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/path: sdf
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T06:22:05Z"
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:spec:
          f:directCSIOwned: {}
          f:requestedFormat:
            .: {}
            f:filesystem: {}
            f:force: {}
      manager: kubectl-directpv
      operation: Update
      time: "2022-01-13T06:23:20Z"
    name: 719d9db1-22d6-4b3c-84ea-cd06cccd76a9
    resourceVersion: "46397"
    uid: e926436b-55b8-40da-ad00-baf32398ffa1
  spec:
    directCSIOwned: true
    requestedFormat:
      filesystem: xfs
      force: true
  status:
    accessTier: Unknown
    allocatedCapacity: 25769803776
    conditions:
    - lastTransitionTime: "2022-01-13T06:22:05Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T06:22:05Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T06:22:05Z"
      message: xfs
      reason: NotAdded
      status: "False"
      type: Formatted
    - lastTransitionTime: "2022-01-13T06:22:05Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Available
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 80
    modelNumber: Virtual_disk
    nodeName: k8s-master-1
    path: /dev/sdf
    physicalBlockSize: 4096
    rootPartition: sdf
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 25769803776
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:50:53Z"
    deletionGracePeriodSeconds: 0
    deletionTimestamp: "2022-01-13T06:14:33Z"
    finalizers:
    - direct.csi.min.io/data-protection
    - direct.csi.min.io.volume/pvc-407f869b-7a09-42a2-aa85-7a077329815a
    generation: 10
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/path: sdf
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io.volume/pvc-407f869b-7a09-42a2-aa85-7a077329815a": {}
            v:"direct.csi.min.io/data-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:freeCapacity: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:11Z"
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:spec:
          f:directCSIOwned: {}
          f:requestedFormat:
            .: {}
            f:filesystem: {}
            f:force: {}
      manager: kubectl-directpv
      operation: Update
      time: "2022-01-13T06:23:20Z"
    name: 1878eada-3cdd-49aa-a2d0-c3683af257b1
    resourceVersion: "46396"
    uid: e0b8b4b1-64dd-4ab8-86c3-8b88d4a93dec
  spec:
    directCSIOwned: true
    requestedFormat:
      filesystem: xfs
      force: true
  status:
    accessTier: Unknown
    allocatedCapacity: 25212211200
    conditions:
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: ""
      reason: Added
      status: "True"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: Mounted
      reason: Added
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: Formatted
      reason: Added
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Terminating
    filesystem: xfs
    filesystemUUID: 75f44593-a3e4-4aa5-96d6-a2ef4b4e8a71
    freeCapacity: 557592576
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 80
    modelNumber: Virtual_disk
    mountpoint: /var/lib/direct-csi/mnt/75f44593-a3e4-4aa5-96d6-a2ef4b4e8a71
    nodeName: k8s-master-1
    path: /dev/sdf
    physicalBlockSize: 512
    rootPartition: sdf
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 25769803776
    ueventFSUUID: 75f44593-a3e4-4aa5-96d6-a2ef4b4e8a71
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:50:53Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/path: sr0
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:majorNumber: {}
          f:modelNumber: {}
          f:nodeName: {}
          f:path: {}
          f:readOnly: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventSerial: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:50:53Z"
    name: ace9030a-8168-4fe2-bd23-5b9d172d6117
    resourceVersion: "2115"
    uid: b904a3d9-0fa8-43b0-964f-082027d291e7
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 1073741312
    conditions:
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: xfs
      reason: NotAdded
      status: "False"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:50:53Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Unavailable
    majorNumber: 11
    modelNumber: VMware_Virtual_SATA_CDRW_Drive
    nodeName: k8s-master-1
    path: /dev/sr0
    readOnly: true
    rootPartition: sr0
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 1073741312
    ueventSerial: "00000000000000000001"
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:03Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/path: dm-0
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:dmName: {}
          f:dmUUID: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:mountOptions: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:virtual: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:48:03Z"
    name: d90b0fbd-7726-4ef4-a1be-90d0afce070f
    resourceVersion: "1482"
    uid: d04050bf-6a20-48a4-a8f8-cefa72508d91
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 37706792960
    conditions:
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: /
      reason: NotAdded
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    dmName: centos_k8s--master--2-root
    dmUUID: LVM-IsdwDYafI0o1Km2c5aW0sEvB6ScxIq9Dy1QqWHkMqwpjTPio0SdE0mphJiRVDGuW
    driveStatus: Unavailable
    filesystem: xfs
    filesystemUUID: 2ac91eb9-76b4-4278-a6a8-678690d83846
    logicalBlockSize: 512
    majorNumber: 253
    mountOptions:
    - relatime
    - rw
    mountpoint: /
    nodeName: k8s-master-2
    path: /dev/dm-0
    physicalBlockSize: 512
    rootPartition: dm-0
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 37706792960
    ueventFSUUID: 2ac91eb9-76b4-4278-a6a8-678690d83846
    virtual: true
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:03Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/path: dm-1
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:dmName: {}
          f:dmUUID: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:virtual: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:48:03Z"
    name: 362be3db-288d-4b11-acd2-3e5a2d14ff44
    resourceVersion: "1479"
    uid: 67fb5fc1-0215-44d1-9bcb-7ba447336b65
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 4160749568
    conditions:
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    dmName: centos_k8s--master--2-swap
    dmUUID: LVM-IsdwDYafI0o1Km2c5aW0sEvB6ScxIq9Dw8qDahtBrNvTjZZdPdE1yMzMpqkdwIeS
    driveStatus: Available
    filesystem: swap
    filesystemUUID: 4e4f30f7-2c93-4e20-bcad-72012a61d57e
    logicalBlockSize: 512
    majorNumber: 253
    minorNumber: 1
    nodeName: k8s-master-2
    path: /dev/dm-1
    physicalBlockSize: 4096
    rootPartition: dm-1
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 4160749568
    ueventFSUUID: 4e4f30f7-2c93-4e20-bcad-72012a61d57e
    virtual: true
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:03Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/path: sda
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:modelNumber: {}
          f:nodeName: {}
          f:partTableType: {}
          f:partitioned: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:48:03Z"
    name: fda6c03b-e333-450e-8f43-1a56ef456e69
    resourceVersion: "1483"
    uid: 13adabff-23b9-41d0-95fe-4d7ef1440e9c
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 42949672960
    conditions:
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: xfs
      reason: NotAdded
      status: "False"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Unavailable
    logicalBlockSize: 512
    majorNumber: 8
    modelNumber: Virtual_disk
    nodeName: k8s-master-2
    partTableType: dos
    partitioned: true
    path: /dev/sda
    physicalBlockSize: 4096
    rootPartition: sda
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 42949672960
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:03Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/path: sda1
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountOptions: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:partTableType: {}
          f:partitionNum: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:48:03Z"
    name: c37bcf6b-5dda-4c85-a428-68bb7ece7871
    resourceVersion: "1474"
    uid: d8e29746-4bc4-4825-b213-998321cec40d
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 1073741824
    conditions:
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: /boot
      reason: NotAdded
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Unavailable
    filesystem: xfs
    filesystemUUID: 21c5d864-3641-423f-917c-347ca8cfbc74
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 1
    modelNumber: Virtual_disk
    mountOptions:
    - relatime
    - rw
    mountpoint: /boot
    nodeName: k8s-master-2
    partTableType: dos
    partitionNum: 1
    path: /dev/sda1
    physicalBlockSize: 512
    rootPartition: sda1
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 1073741824
    ueventFSUUID: 21c5d864-3641-423f-917c-347ca8cfbc74
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:03Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/path: sda2
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:master: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:nodeName: {}
          f:partTableType: {}
          f:partitionNum: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:48:03Z"
    name: d9850cd4-3b0f-4413-8228-11429f105478
    resourceVersion: "1475"
    uid: 98e244e0-7708-43d4-b5e2-4ce47176440d
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 41874882560
    conditions:
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Unavailable
    filesystem: LVM2_member
    filesystemUUID: QLvfZj-q7l7-nY4b-2mjm-6X1G-vZVz-BFLo1v
    logicalBlockSize: 512
    majorNumber: 8
    master: dm-1
    minorNumber: 2
    modelNumber: Virtual_disk
    nodeName: k8s-master-2
    partTableType: dos
    partitionNum: 2
    path: /dev/sda2
    physicalBlockSize: 4096
    rootPartition: sda2
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 41874882560
    ueventFSUUID: QLvfZj-q7l7-nY4b-2mjm-6X1G-vZVz-BFLo1v
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:03Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/path: sdb
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:48:03Z"
    name: 2825e6d5-6ec3-4976-bdcf-d86ffad82aeb
    resourceVersion: "1477"
    uid: dedf5276-63df-4413-8621-ca770468ce35
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 42949672960
    conditions:
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: xfs
      reason: NotAdded
      status: "False"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Available
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 16
    modelNumber: Virtual_disk
    nodeName: k8s-master-2
    path: /dev/sdb
    physicalBlockSize: 4096
    rootPartition: sdb
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 42949672960
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:03Z"
    finalizers:
    - direct.csi.min.io/data-protection
    - direct.csi.min.io.volume/pvc-625f0556-910b-4cab-a088-08ac47a3b44b
    generation: 7
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/path: sdc
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:spec:
          f:directCSIOwned: {}
      manager: kubectl-directpv
      operation: Update
      time: "2022-01-13T03:54:09Z"
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io.volume/pvc-625f0556-910b-4cab-a088-08ac47a3b44b": {}
            v:"direct.csi.min.io/data-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:freeCapacity: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:10Z"
    name: d8f51682-5ff9-47ac-a50c-c6615be2b7a0
    resourceVersion: "38808"
    uid: 10e60a58-44ae-4e4f-8853-0bd3ecd86613
  spec:
    directCSIOwned: true
  status:
    accessTier: Unknown
    allocatedCapacity: 25212211200
    conditions:
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: ""
      reason: Added
      status: "True"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: Mounted
      reason: Added
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: Formatted
      reason: Added
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: InUse
    filesystem: xfs
    filesystemUUID: fe87322c-2a30-4c2e-8b2a-c02c2de8701b
    freeCapacity: 557592576
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 32
    modelNumber: Virtual_disk
    mountpoint: /var/lib/direct-csi/mnt/fe87322c-2a30-4c2e-8b2a-c02c2de8701b
    nodeName: k8s-master-2
    path: /dev/sdc
    physicalBlockSize: 512
    rootPartition: sdc
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 25769803776
    ueventFSUUID: fe87322c-2a30-4c2e-8b2a-c02c2de8701b
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:03Z"
    finalizers:
    - direct.csi.min.io/data-protection
    - direct.csi.min.io.volume/pvc-9e9200f2-ad54-4bf3-9f0d-da4881bd098c
    generation: 7
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/path: sdd
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:spec:
          f:directCSIOwned: {}
      manager: kubectl-directpv
      operation: Update
      time: "2022-01-13T03:54:09Z"
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io.volume/pvc-9e9200f2-ad54-4bf3-9f0d-da4881bd098c": {}
            v:"direct.csi.min.io/data-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:freeCapacity: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:10Z"
    name: d694dc48-af1a-4cc1-a602-f802c9f0ebec
    resourceVersion: "38801"
    uid: 461fb714-f07e-4147-9493-f220452a1c10
  spec:
    directCSIOwned: true
  status:
    accessTier: Unknown
    allocatedCapacity: 25212211200
    conditions:
    - lastTransitionTime: "2022-01-13T03:54:09Z"
      message: ""
      reason: Added
      status: "True"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:54:09Z"
      message: Mounted
      reason: Added
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:54:09Z"
      message: Formatted
      reason: Added
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: InUse
    filesystem: xfs
    filesystemUUID: 3e36092d-7c44-4520-87ce-b3178229d4af
    freeCapacity: 557592576
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 48
    modelNumber: Virtual_disk
    mountpoint: /var/lib/direct-csi/mnt/3e36092d-7c44-4520-87ce-b3178229d4af
    nodeName: k8s-master-2
    path: /dev/sdd
    physicalBlockSize: 512
    rootPartition: sdd
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 25769803776
    ueventFSUUID: 3e36092d-7c44-4520-87ce-b3178229d4af
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:03Z"
    finalizers:
    - direct.csi.min.io/data-protection
    - direct.csi.min.io.volume/pvc-8ac6c63c-cb46-4719-96ab-9adf3ba141f0
    generation: 7
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/path: sde
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:spec:
          f:directCSIOwned: {}
      manager: kubectl-directpv
      operation: Update
      time: "2022-01-13T03:54:09Z"
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io.volume/pvc-8ac6c63c-cb46-4719-96ab-9adf3ba141f0": {}
            v:"direct.csi.min.io/data-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:freeCapacity: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:10Z"
    name: 99ba9127-e44b-4896-976c-20b065391590
    resourceVersion: "38788"
    uid: 926e599b-00b7-4968-9c06-c4f619c3522d
  spec:
    directCSIOwned: true
  status:
    accessTier: Unknown
    allocatedCapacity: 25212211200
    conditions:
    - lastTransitionTime: "2022-01-13T03:54:09Z"
      message: ""
      reason: Added
      status: "True"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:54:09Z"
      message: Mounted
      reason: Added
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:54:09Z"
      message: Formatted
      reason: Added
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: InUse
    filesystem: xfs
    filesystemUUID: 55afb26b-24e0-4736-9b3f-a53ee67a18aa
    freeCapacity: 557592576
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 64
    modelNumber: Virtual_disk
    mountpoint: /var/lib/direct-csi/mnt/55afb26b-24e0-4736-9b3f-a53ee67a18aa
    nodeName: k8s-master-2
    path: /dev/sde
    physicalBlockSize: 512
    rootPartition: sde
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 25769803776
    ueventFSUUID: 55afb26b-24e0-4736-9b3f-a53ee67a18aa
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:03Z"
    finalizers:
    - direct.csi.min.io/data-protection
    - direct.csi.min.io.volume/pvc-29dbbc83-2456-4062-b02a-cc90c377b3ce
    generation: 7
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/path: sdf
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:spec:
          f:directCSIOwned: {}
      manager: kubectl-directpv
      operation: Update
      time: "2022-01-13T03:54:09Z"
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io.volume/pvc-29dbbc83-2456-4062-b02a-cc90c377b3ce": {}
            v:"direct.csi.min.io/data-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:freeCapacity: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:10Z"
    name: 54cabbc0-e2ac-445b-a65a-ed1757b1122c
    resourceVersion: "38785"
    uid: 8c75ff0d-8609-4dc9-a73a-36ab592eb689
  spec:
    directCSIOwned: true
  status:
    accessTier: Unknown
    allocatedCapacity: 25212211200
    conditions:
    - lastTransitionTime: "2022-01-13T03:54:09Z"
      message: ""
      reason: Added
      status: "True"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:54:09Z"
      message: Mounted
      reason: Added
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:54:09Z"
      message: Formatted
      reason: Added
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: InUse
    filesystem: xfs
    filesystemUUID: 5769e9ac-096f-46a9-ae90-347e7596f4a5
    freeCapacity: 557592576
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 80
    modelNumber: Virtual_disk
    mountpoint: /var/lib/direct-csi/mnt/5769e9ac-096f-46a9-ae90-347e7596f4a5
    nodeName: k8s-master-2
    path: /dev/sdf
    physicalBlockSize: 512
    rootPartition: sdf
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 25769803776
    ueventFSUUID: 5769e9ac-096f-46a9-ae90-347e7596f4a5
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:03Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/path: sr0
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:majorNumber: {}
          f:modelNumber: {}
          f:nodeName: {}
          f:path: {}
          f:readOnly: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventSerial: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:48:03Z"
    name: ed7ba484-f513-4a38-bee1-d924fbace974
    resourceVersion: "1481"
    uid: 9b3a8b71-bb91-4faa-9ba3-1c97924c3831
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 1073741312
    conditions:
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: xfs
      reason: NotAdded
      status: "False"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:03Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Unavailable
    majorNumber: 11
    modelNumber: VMware_Virtual_SATA_CDRW_Drive
    nodeName: k8s-master-2
    path: /dev/sr0
    readOnly: true
    rootPartition: sr0
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 1073741312
    ueventSerial: "00000000000000000001"
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:04Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/path: dm-0
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:dmName: {}
          f:dmUUID: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:mountOptions: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:virtual: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:48:04Z"
    name: 562e2508-7765-404a-afdf-96a1f49ad0c5
    resourceVersion: "1504"
    uid: 361456e1-02ec-4811-9fc7-d803f4786a78
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 39766196224
    conditions:
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: /
      reason: NotAdded
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    dmName: centos_k8s--node--2-root
    dmUUID: LVM-Kcf5GdfjYE1a1X0tuxkUEMgSt79HXB6fXL9bpHrYUAwW8GiDUS4kMuopAqp1Bjwr
    driveStatus: Unavailable
    filesystem: xfs
    filesystemUUID: e4fb6959-ebce-4df1-b29c-0d40a96bf2cd
    logicalBlockSize: 512
    majorNumber: 253
    mountOptions:
    - relatime
    - rw
    mountpoint: /
    nodeName: k8s-node-1
    path: /dev/dm-0
    physicalBlockSize: 512
    rootPartition: dm-0
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 39766196224
    ueventFSUUID: e4fb6959-ebce-4df1-b29c-0d40a96bf2cd
    virtual: true
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:04Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/path: dm-1
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:dmName: {}
          f:dmUUID: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:virtual: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:48:04Z"
    name: 106406a2-8907-4e12-86b5-e3987c6d7c92
    resourceVersion: "1501"
    uid: 60f93f4c-c663-4f6c-877f-b7402bb92071
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 4160749568
    conditions:
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    dmName: centos_k8s--node--2-swap
    dmUUID: LVM-Kcf5GdfjYE1a1X0tuxkUEMgSt79HXB6fs9gZrKAYSql7kMLTnZGQCL8963iqoczi
    driveStatus: Available
    filesystem: swap
    filesystemUUID: fc6ed60c-e227-4275-8c07-56dff717aecf
    logicalBlockSize: 512
    majorNumber: 253
    minorNumber: 1
    nodeName: k8s-node-1
    path: /dev/dm-1
    physicalBlockSize: 4096
    rootPartition: dm-1
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 4160749568
    ueventFSUUID: fc6ed60c-e227-4275-8c07-56dff717aecf
    virtual: true
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:04Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/path: dm-2
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:dmName: {}
          f:dmUUID: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:mountOptions: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:virtual: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:48:04Z"
    name: d6b57481-9582-483c-92e1-c3dc9cb91d87
    resourceVersion: "1505"
    uid: 48c3bab4-32eb-4f06-8311-18bb583630ce
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 19415433216
    conditions:
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: /home
      reason: NotAdded
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    dmName: centos_k8s--node--2-home
    dmUUID: LVM-Kcf5GdfjYE1a1X0tuxkUEMgSt79HXB6fLP738yFr9ogJMZRD7Rwz8Z78YpZVHzKu
    driveStatus: Unavailable
    filesystem: xfs
    filesystemUUID: 266327e9-bba8-4fdf-8f67-9cea4fa84f79
    logicalBlockSize: 512
    majorNumber: 253
    minorNumber: 2
    mountOptions:
    - relatime
    - rw
    mountpoint: /home
    nodeName: k8s-node-1
    path: /dev/dm-2
    physicalBlockSize: 512
    rootPartition: dm-2
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 19415433216
    ueventFSUUID: 266327e9-bba8-4fdf-8f67-9cea4fa84f79
    virtual: true
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:04Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/path: sda
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:modelNumber: {}
          f:nodeName: {}
          f:partTableType: {}
          f:partitioned: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:48:04Z"
    name: d157e06f-c6a5-44f0-bfff-b020f507155b
    resourceVersion: "1508"
    uid: f6bff2c7-e834-4bca-8e04-debb66a71dff
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 64424509440
    conditions:
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: xfs
      reason: NotAdded
      status: "False"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Unavailable
    logicalBlockSize: 512
    majorNumber: 8
    modelNumber: Virtual_disk
    nodeName: k8s-node-1
    partTableType: dos
    partitioned: true
    path: /dev/sda
    physicalBlockSize: 4096
    rootPartition: sda
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 64424509440
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:04Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/path: sda1
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountOptions: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:partTableType: {}
          f:partitionNum: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:48:04Z"
    name: f827432d-fc92-42fc-ace8-b619472e33a5
    resourceVersion: "1507"
    uid: 4a64032a-a6cd-44fc-bbd8-6844061b2db2
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 1073741824
    conditions:
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: /boot
      reason: NotAdded
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Unavailable
    filesystem: xfs
    filesystemUUID: 10b516e1-ec27-44bc-bd81-20468c966e64
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 1
    modelNumber: Virtual_disk
    mountOptions:
    - relatime
    - rw
    mountpoint: /boot
    nodeName: k8s-node-1
    partTableType: dos
    partitionNum: 1
    path: /dev/sda1
    physicalBlockSize: 512
    rootPartition: sda1
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 1073741824
    ueventFSUUID: 10b516e1-ec27-44bc-bd81-20468c966e64
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:04Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/path: sda2
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:master: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:nodeName: {}
          f:partTableType: {}
          f:partitionNum: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:48:04Z"
    name: fcc3a5c2-271a-4c1a-be9f-6284e2c80d4d
    resourceVersion: "1500"
    uid: 01e1d078-13c1-4499-bffb-daad414b0347
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 63349719040
    conditions:
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Unavailable
    filesystem: LVM2_member
    filesystemUUID: zCBhE3-z8mH-2VQX-WmWq-1pEE-vS5H-UPzxdf
    logicalBlockSize: 512
    majorNumber: 8
    master: dm-2
    minorNumber: 2
    modelNumber: Virtual_disk
    nodeName: k8s-node-1
    partTableType: dos
    partitionNum: 2
    path: /dev/sda2
    physicalBlockSize: 4096
    rootPartition: sda2
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 63349719040
    ueventFSUUID: zCBhE3-z8mH-2VQX-WmWq-1pEE-vS5H-UPzxdf
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:04Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/path: sdb
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:48:04Z"
    name: 5f4053ae-803a-4244-b1d0-b4acdc601b4b
    resourceVersion: "1498"
    uid: 3e480213-7bb4-4df7-af6a-410092bd3bbc
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 42949672960
    conditions:
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Available
    filesystem: xfs
    filesystemUUID: 454fd1a0-bcbc-477c-a6de-2607bd0f3fbb
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 16
    modelNumber: Virtual_disk
    nodeName: k8s-node-1
    path: /dev/sdb
    physicalBlockSize: 4096
    rootPartition: sdb
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 42949672960
    ueventFSUUID: 454fd1a0-bcbc-477c-a6de-2607bd0f3fbb
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:04Z"
    finalizers:
    - direct.csi.min.io/data-protection
    generation: 4
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/path: sdc
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:spec:
          f:directCSIOwned: {}
      manager: kubectl-directpv
      operation: Update
      time: "2022-01-13T03:54:09Z"
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io/data-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:freeCapacity: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:54:10Z"
    name: cdf0228c-508b-40ce-bc53-49239e6f6cbe
    resourceVersion: "2897"
    uid: 9c088c4e-f0a2-42c7-a3d7-aff3a622cd5b
  spec:
    directCSIOwned: true
  status:
    accessTier: Unknown
    allocatedCapacity: 46387200
    conditions:
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: ""
      reason: Added
      status: "True"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: Mounted
      reason: Added
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: Formatted
      reason: Added
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Ready
    filesystem: xfs
    filesystemUUID: c7842b85-e533-41b0-814d-ab2a93563a52
    freeCapacity: 25723416576
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 32
    modelNumber: Virtual_disk
    mountpoint: /var/lib/direct-csi/mnt/c7842b85-e533-41b0-814d-ab2a93563a52
    nodeName: k8s-node-1
    path: /dev/sdc
    physicalBlockSize: 512
    rootPartition: sdc
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 25769803776
    ueventFSUUID: c7842b85-e533-41b0-814d-ab2a93563a52
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:04Z"
    finalizers:
    - direct.csi.min.io/data-protection
    - direct.csi.min.io.volume/pvc-72c00d13-27ea-4d98-8b05-ddd6f763808e
    generation: 7
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/path: sdd
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:spec:
          f:directCSIOwned: {}
      manager: kubectl-directpv
      operation: Update
      time: "2022-01-13T03:54:09Z"
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io.volume/pvc-72c00d13-27ea-4d98-8b05-ddd6f763808e": {}
            v:"direct.csi.min.io/data-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:freeCapacity: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:11Z"
    name: ed7d936c-d63d-437a-9e68-13cb17d104da
    resourceVersion: "38845"
    uid: 0f024131-dc70-4fac-aa41-07b24a90a886
  spec:
    directCSIOwned: true
  status:
    accessTier: Unknown
    allocatedCapacity: 25212211200
    conditions:
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: ""
      reason: Added
      status: "True"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: Mounted
      reason: Added
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: Formatted
      reason: Added
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: InUse
    filesystem: xfs
    filesystemUUID: a57e01f0-b9bf-4a1b-8f8f-4f7543d47fee
    freeCapacity: 557592576
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 48
    modelNumber: Virtual_disk
    mountpoint: /var/lib/direct-csi/mnt/a57e01f0-b9bf-4a1b-8f8f-4f7543d47fee
    nodeName: k8s-node-1
    path: /dev/sdd
    physicalBlockSize: 512
    rootPartition: sdd
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 25769803776
    ueventFSUUID: a57e01f0-b9bf-4a1b-8f8f-4f7543d47fee
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:04Z"
    finalizers:
    - direct.csi.min.io/data-protection
    - direct.csi.min.io.volume/pvc-1153ab0b-3201-44d4-95df-5ecff66f8bad
    generation: 7
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/path: sde
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:spec:
          f:directCSIOwned: {}
      manager: kubectl-directpv
      operation: Update
      time: "2022-01-13T03:54:09Z"
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io.volume/pvc-1153ab0b-3201-44d4-95df-5ecff66f8bad": {}
            v:"direct.csi.min.io/data-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:freeCapacity: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:11Z"
    name: 2a736109-c333-4316-a2b1-201f0a86bd88
    resourceVersion: "38839"
    uid: d8991768-31f1-406d-9285-36381cab2fa2
  spec:
    directCSIOwned: true
  status:
    accessTier: Unknown
    allocatedCapacity: 25212211200
    conditions:
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: ""
      reason: Added
      status: "True"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: Mounted
      reason: Added
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:54:10Z"
      message: Formatted
      reason: Added
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: InUse
    filesystem: xfs
    filesystemUUID: f9c4284f-6bee-4fc9-bf2c-a5f9ad4b802a
    freeCapacity: 557592576
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 64
    modelNumber: Virtual_disk
    mountpoint: /var/lib/direct-csi/mnt/f9c4284f-6bee-4fc9-bf2c-a5f9ad4b802a
    nodeName: k8s-node-1
    path: /dev/sde
    physicalBlockSize: 512
    rootPartition: sde
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 25769803776
    ueventFSUUID: f9c4284f-6bee-4fc9-bf2c-a5f9ad4b802a
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:04Z"
    finalizers:
    - direct.csi.min.io/data-protection
    - direct.csi.min.io.volume/pvc-1258d651-d862-429e-b0b3-41b1cbd5f471
    generation: 7
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/path: sdf
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:spec:
          f:directCSIOwned: {}
      manager: kubectl-directpv
      operation: Update
      time: "2022-01-13T03:54:09Z"
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io.volume/pvc-1258d651-d862-429e-b0b3-41b1cbd5f471": {}
            v:"direct.csi.min.io/data-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:freeCapacity: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:10Z"
    name: 40ce7a36-a8ba-44dd-9bf4-a6be0f3d892d
    resourceVersion: "38763"
    uid: 37435656-80da-4b12-9667-792e68b79f8e
  spec:
    directCSIOwned: true
  status:
    accessTier: Unknown
    allocatedCapacity: 25212211200
    conditions:
    - lastTransitionTime: "2022-01-13T03:54:09Z"
      message: ""
      reason: Added
      status: "True"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:54:09Z"
      message: Mounted
      reason: Added
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:54:09Z"
      message: Formatted
      reason: Added
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: InUse
    filesystem: xfs
    filesystemUUID: ac8123a9-cf03-4f3a-a4a3-75b5f8491a75
    freeCapacity: 557592576
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 80
    modelNumber: Virtual_disk
    mountpoint: /var/lib/direct-csi/mnt/ac8123a9-cf03-4f3a-a4a3-75b5f8491a75
    nodeName: k8s-node-1
    path: /dev/sdf
    physicalBlockSize: 512
    rootPartition: sdf
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 25769803776
    ueventFSUUID: ac8123a9-cf03-4f3a-a4a3-75b5f8491a75
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:04Z"
    finalizers:
    - direct.csi.min.io/data-protection
    - direct.csi.min.io.volume/pvc-783e1034-305b-42c4-9637-2459328c5a51
    generation: 7
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/path: sdg
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:spec:
          f:directCSIOwned: {}
      manager: kubectl-directpv
      operation: Update
      time: "2022-01-13T03:54:09Z"
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io.volume/pvc-783e1034-305b-42c4-9637-2459328c5a51": {}
            v:"direct.csi.min.io/data-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:freeCapacity: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:10Z"
    name: b2f44faf-31ae-4515-af18-db00378c147d
    resourceVersion: "38770"
    uid: 62e37c89-6cc4-47d8-a98b-543dd29733ec
  spec:
    directCSIOwned: true
  status:
    accessTier: Unknown
    allocatedCapacity: 25212211200
    conditions:
    - lastTransitionTime: "2022-01-13T03:54:09Z"
      message: ""
      reason: Added
      status: "True"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:54:09Z"
      message: Mounted
      reason: Added
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:54:09Z"
      message: Formatted
      reason: Added
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: InUse
    filesystem: xfs
    filesystemUUID: e09658d1-c996-40c2-b9ac-aa314b981205
    freeCapacity: 557592576
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 96
    modelNumber: Virtual_disk
    mountpoint: /var/lib/direct-csi/mnt/e09658d1-c996-40c2-b9ac-aa314b981205
    nodeName: k8s-node-1
    path: /dev/sdg
    physicalBlockSize: 512
    rootPartition: sdg
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 25769803776
    ueventFSUUID: e09658d1-c996-40c2-b9ac-aa314b981205
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:48:04Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/path: sr0
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:majorNumber: {}
          f:modelNumber: {}
          f:nodeName: {}
          f:path: {}
          f:readOnly: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventSerial: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:48:04Z"
    name: ed5c8e19-30b3-4fe6-9c05-038c777bf951
    resourceVersion: "1503"
    uid: beb661e9-7506-4d7f-8975-b722d7da6bc7
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 1073741312
    conditions:
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: xfs
      reason: NotAdded
      status: "False"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:48:04Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Unavailable
    majorNumber: 11
    modelNumber: VMware_Virtual_SATA_CDRW_Drive
    nodeName: k8s-node-1
    path: /dev/sr0
    readOnly: true
    rootPartition: sr0
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 1073741312
    ueventSerial: "00000000000000000001"
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:56:06Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/path: dm-0
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:dmName: {}
          f:dmUUID: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:mountOptions: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:virtual: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:56:06Z"
    name: ba37c041-fea1-41b6-b31d-d1b05aa9c534
    resourceVersion: "3367"
    uid: bfcba8e0-04cb-4548-a04d-8c0e4a788d46
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 39766196224
    conditions:
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: /
      reason: NotAdded
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    dmName: centos_k8s--node--1-root
    dmUUID: LVM-YlyEDTkk57w9f2lrd64sqj3piOsgDPOpZ7B1KRTjQCGvA36SDKnO6MsvBpS52cFF
    driveStatus: Unavailable
    filesystem: xfs
    filesystemUUID: 1bd11f6f-2fdb-46bf-a871-7c6104fdcb90
    logicalBlockSize: 512
    majorNumber: 253
    mountOptions:
    - relatime
    - rw
    mountpoint: /
    nodeName: k8s-node-2
    path: /dev/dm-0
    physicalBlockSize: 512
    rootPartition: dm-0
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 39766196224
    ueventFSUUID: 1bd11f6f-2fdb-46bf-a871-7c6104fdcb90
    virtual: true
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:56:06Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/path: dm-1
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:dmName: {}
          f:dmUUID: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:virtual: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:56:06Z"
    name: 13a52116-1140-4560-91fa-30b2c7b52ae8
    resourceVersion: "3361"
    uid: 1676c699-041d-4f3f-86fb-e13ed56506fa
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 4160749568
    conditions:
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    dmName: centos_k8s--node--1-swap
    dmUUID: LVM-YlyEDTkk57w9f2lrd64sqj3piOsgDPOpJHzfaObPV9oMYpZKbdVt2HAM6nv5Ktmd
    driveStatus: Available
    filesystem: swap
    filesystemUUID: 002def48-058d-43ff-be87-f7343f1df2bb
    logicalBlockSize: 512
    majorNumber: 253
    minorNumber: 1
    nodeName: k8s-node-2
    path: /dev/dm-1
    physicalBlockSize: 4096
    rootPartition: dm-1
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 4160749568
    ueventFSUUID: 002def48-058d-43ff-be87-f7343f1df2bb
    virtual: true
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:56:06Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/path: dm-2
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:dmName: {}
          f:dmUUID: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:mountOptions: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:virtual: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:56:06Z"
    name: a260e09f-f8fd-442b-8ee9-5733db2201b3
    resourceVersion: "3362"
    uid: da751307-69ec-4313-b2d8-ad14de1968c7
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 19415433216
    conditions:
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: /home
      reason: NotAdded
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    dmName: centos_k8s--node--1-home
    dmUUID: LVM-YlyEDTkk57w9f2lrd64sqj3piOsgDPOpTiNOOFP1cfrcMzScux2TDopfBpHA5HRz
    driveStatus: Unavailable
    filesystem: xfs
    filesystemUUID: b8a2354a-d7df-4543-9db0-6f9a28819a9b
    logicalBlockSize: 512
    majorNumber: 253
    minorNumber: 2
    mountOptions:
    - relatime
    - rw
    mountpoint: /home
    nodeName: k8s-node-2
    path: /dev/dm-2
    physicalBlockSize: 512
    rootPartition: dm-2
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 19415433216
    ueventFSUUID: b8a2354a-d7df-4543-9db0-6f9a28819a9b
    virtual: true
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:56:06Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/path: sda
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:modelNumber: {}
          f:nodeName: {}
          f:partTableType: {}
          f:partitioned: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:56:06Z"
    name: 965ce3d1-3fa3-4882-a67a-6986e6be231c
    resourceVersion: "3365"
    uid: caf897ac-f727-4663-b47f-7488fc6c95fe
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 64424509440
    conditions:
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: xfs
      reason: NotAdded
      status: "False"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Unavailable
    logicalBlockSize: 512
    majorNumber: 8
    modelNumber: Virtual_disk
    nodeName: k8s-node-2
    partTableType: dos
    partitioned: true
    path: /dev/sda
    physicalBlockSize: 4096
    rootPartition: sda
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 64424509440
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:56:06Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/path: sda1
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountOptions: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:partTableType: {}
          f:partitionNum: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:56:06Z"
    name: 5966850f-8e16-4740-a4c3-27f103ff8eee
    resourceVersion: "3370"
    uid: 1681efc3-80e5-45f3-9f73-7186bcd5ecdf
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 1073741824
    conditions:
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: /boot
      reason: NotAdded
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Unavailable
    filesystem: xfs
    filesystemUUID: 569eb51f-753c-4673-9c8d-d73399e56d58
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 1
    modelNumber: Virtual_disk
    mountOptions:
    - relatime
    - rw
    mountpoint: /boot
    nodeName: k8s-node-2
    partTableType: dos
    partitionNum: 1
    path: /dev/sda1
    physicalBlockSize: 512
    rootPartition: sda1
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 1073741824
    ueventFSUUID: 569eb51f-753c-4673-9c8d-d73399e56d58
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:56:06Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/path: sda2
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:master: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:nodeName: {}
          f:partTableType: {}
          f:partitionNum: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:56:06Z"
    name: e7cdeb4c-b3fd-45b9-8a92-adc4bce43afb
    resourceVersion: "3371"
    uid: 6c8f8b2a-7e50-439b-b67a-367b738c3a3b
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 63349719040
    conditions:
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: xfs
      reason: NotAdded
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Unavailable
    filesystem: LVM2_member
    filesystemUUID: bSNeIL-jYWi-pAMU-FNYV-q4Q2-g00q-eCqu2z
    logicalBlockSize: 512
    majorNumber: 8
    master: dm-2
    minorNumber: 2
    modelNumber: Virtual_disk
    nodeName: k8s-node-2
    partTableType: dos
    partitionNum: 2
    path: /dev/sda2
    physicalBlockSize: 4096
    rootPartition: sda2
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 63349719040
    ueventFSUUID: bSNeIL-jYWi-pAMU-FNYV-q4Q2-g00q-eCqu2z
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:56:06Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/path: sdb
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:56:06Z"
    name: 79b8ba88-b7aa-454f-925e-779ca571d32b
    resourceVersion: "3363"
    uid: a0212fea-3520-432f-8e02-261340fcea2b
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 42949672960
    conditions:
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: xfs
      reason: NotAdded
      status: "False"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Available
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 16
    modelNumber: Virtual_disk
    nodeName: k8s-node-2
    path: /dev/sdb
    physicalBlockSize: 4096
    rootPartition: sdb
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 42949672960
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:56:06Z"
    finalizers:
    - direct.csi.min.io/data-protection
    - direct.csi.min.io.volume/pvc-9f09fd4b-c3bf-4c80-9976-562841198950
    generation: 7
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/path: sdc
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:spec:
          f:directCSIOwned: {}
      manager: kubectl-directpv
      operation: Update
      time: "2022-01-13T03:56:25Z"
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io.volume/pvc-9f09fd4b-c3bf-4c80-9976-562841198950": {}
            v:"direct.csi.min.io/data-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:freeCapacity: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:09Z"
    name: 1fff922a-7230-4342-a831-e61dc6caeb25
    resourceVersion: "38667"
    uid: e50c85a7-9a03-4042-b267-f74c654d5674
  spec:
    directCSIOwned: true
  status:
    accessTier: Unknown
    allocatedCapacity: 25212211200
    conditions:
    - lastTransitionTime: "2022-01-13T03:56:25Z"
      message: ""
      reason: Added
      status: "True"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:56:25Z"
      message: Mounted
      reason: Added
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:56:25Z"
      message: Formatted
      reason: Added
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: InUse
    filesystem: xfs
    filesystemUUID: e85615af-8f9d-4aa8-83cd-4d5fad782660
    freeCapacity: 557592576
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 32
    modelNumber: Virtual_disk
    mountpoint: /var/lib/direct-csi/mnt/e85615af-8f9d-4aa8-83cd-4d5fad782660
    nodeName: k8s-node-2
    path: /dev/sdc
    physicalBlockSize: 512
    rootPartition: sdc
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 25769803776
    ueventFSUUID: e85615af-8f9d-4aa8-83cd-4d5fad782660
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:56:06Z"
    finalizers:
    - direct.csi.min.io/data-protection
    - direct.csi.min.io.volume/pvc-d8d24739-794c-4f2e-84dc-5c64b31dbebc
    generation: 7
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/path: sdd
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:spec:
          f:directCSIOwned: {}
      manager: kubectl-directpv
      operation: Update
      time: "2022-01-13T03:56:25Z"
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io.volume/pvc-d8d24739-794c-4f2e-84dc-5c64b31dbebc": {}
            v:"direct.csi.min.io/data-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:freeCapacity: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:09Z"
    name: 41484724-341c-46db-830f-b24a2c15aec4
    resourceVersion: "38705"
    uid: 91168ee8-d587-41d2-8cd4-df8b73e86c56
  spec:
    directCSIOwned: true
  status:
    accessTier: Unknown
    allocatedCapacity: 25212211200
    conditions:
    - lastTransitionTime: "2022-01-13T03:56:25Z"
      message: ""
      reason: Added
      status: "True"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:56:25Z"
      message: Mounted
      reason: Added
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:56:25Z"
      message: Formatted
      reason: Added
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: InUse
    filesystem: xfs
    filesystemUUID: ac3b26e1-f844-456d-95d6-b760d58a3c67
    freeCapacity: 557592576
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 48
    modelNumber: Virtual_disk
    mountpoint: /var/lib/direct-csi/mnt/ac3b26e1-f844-456d-95d6-b760d58a3c67
    nodeName: k8s-node-2
    path: /dev/sdd
    physicalBlockSize: 512
    rootPartition: sdd
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 25769803776
    ueventFSUUID: ac3b26e1-f844-456d-95d6-b760d58a3c67
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:56:06Z"
    finalizers:
    - direct.csi.min.io/data-protection
    - direct.csi.min.io.volume/pvc-b5df52a4-ba50-4519-935f-4820ad2b5967
    generation: 7
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/path: sde
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:spec:
          f:directCSIOwned: {}
      manager: kubectl-directpv
      operation: Update
      time: "2022-01-13T03:56:25Z"
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io.volume/pvc-b5df52a4-ba50-4519-935f-4820ad2b5967": {}
            v:"direct.csi.min.io/data-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:freeCapacity: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:09Z"
    name: f2a06cce-6e21-4931-bee8-21a9bc55bf4c
    resourceVersion: "38676"
    uid: 8de8023a-15eb-4105-bbb3-6d16d478049a
  spec:
    directCSIOwned: true
  status:
    accessTier: Unknown
    allocatedCapacity: 25212211200
    conditions:
    - lastTransitionTime: "2022-01-13T03:56:25Z"
      message: ""
      reason: Added
      status: "True"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:56:25Z"
      message: Mounted
      reason: Added
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:56:25Z"
      message: Formatted
      reason: Added
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: InUse
    filesystem: xfs
    filesystemUUID: f62b0492-ea40-4972-baf6-7010c8c441f5
    freeCapacity: 557592576
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 64
    modelNumber: Virtual_disk
    mountpoint: /var/lib/direct-csi/mnt/f62b0492-ea40-4972-baf6-7010c8c441f5
    nodeName: k8s-node-2
    path: /dev/sde
    physicalBlockSize: 512
    rootPartition: sde
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 25769803776
    ueventFSUUID: f62b0492-ea40-4972-baf6-7010c8c441f5
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:56:06Z"
    finalizers:
    - direct.csi.min.io/data-protection
    - direct.csi.min.io.volume/pvc-ec6e9d77-ee37-4bc7-91a7-bd48dec5285a
    - direct.csi.min.io.volume/pvc-68f6fe63-3d6d-4628-af30-2275f7b09ac0
    generation: 8
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/path: sdf
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:spec:
          f:directCSIOwned: {}
      manager: kubectl-directpv
      operation: Update
      time: "2022-01-13T03:56:25Z"
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io.volume/pvc-68f6fe63-3d6d-4628-af30-2275f7b09ac0": {}
            v:"direct.csi.min.io.volume/pvc-ec6e9d77-ee37-4bc7-91a7-bd48dec5285a": {}
            v:"direct.csi.min.io/data-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:freeCapacity: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:53:12Z"
    name: ee98ef05-9c97-4f98-892f-e2e43b344e9c
    resourceVersion: "39802"
    uid: 30ccee47-6e78-42d9-9a4c-67418f628fbc
  spec:
    directCSIOwned: true
  status:
    accessTier: Unknown
    allocatedCapacity: 10783805440
    conditions:
    - lastTransitionTime: "2022-01-13T03:56:26Z"
      message: ""
      reason: Added
      status: "True"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:56:26Z"
      message: Mounted
      reason: Added
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:56:26Z"
      message: Formatted
      reason: Added
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: InUse
    filesystem: xfs
    filesystemUUID: 83d547c2-cc9c-495a-bd9e-d2d186c2f2f1
    freeCapacity: 14985998336
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 80
    modelNumber: Virtual_disk
    mountpoint: /var/lib/direct-csi/mnt/83d547c2-cc9c-495a-bd9e-d2d186c2f2f1
    nodeName: k8s-node-2
    path: /dev/sdf
    physicalBlockSize: 512
    rootPartition: sdf
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 25769803776
    ueventFSUUID: 83d547c2-cc9c-495a-bd9e-d2d186c2f2f1
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:56:06Z"
    finalizers:
    - direct.csi.min.io/data-protection
    - direct.csi.min.io.volume/pvc-dddba84b-3473-4441-b49f-b24ff38132e3
    generation: 5
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/path: sdg
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:spec:
          f:directCSIOwned: {}
      manager: kubectl-directpv
      operation: Update
      time: "2022-01-13T03:56:25Z"
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io.volume/pvc-dddba84b-3473-4441-b49f-b24ff38132e3": {}
            v:"direct.csi.min.io/data-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:filesystem: {}
          f:filesystemUUID: {}
          f:freeCapacity: {}
          f:logicalBlockSize: {}
          f:majorNumber: {}
          f:minorNumber: {}
          f:modelNumber: {}
          f:mountpoint: {}
          f:nodeName: {}
          f:path: {}
          f:physicalBlockSize: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventFSUUID: {}
          f:vendor: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:09Z"
    name: 07161aca-0b78-4531-861d-7bfee05d0995
    resourceVersion: "38704"
    uid: 5fe4d204-fe05-4b2f-ac79-5ce1316c9e72
  spec:
    directCSIOwned: true
  status:
    accessTier: Unknown
    allocatedCapacity: 25212211200
    conditions:
    - lastTransitionTime: "2022-01-13T03:56:25Z"
      message: ""
      reason: Added
      status: "True"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:56:25Z"
      message: Mounted
      reason: Added
      status: "True"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:56:25Z"
      message: Formatted
      reason: Added
      status: "True"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: InUse
    filesystem: xfs
    filesystemUUID: e41200e7-beea-430f-b37a-4c380b98fa09
    freeCapacity: 557592576
    logicalBlockSize: 512
    majorNumber: 8
    minorNumber: 96
    modelNumber: Virtual_disk
    mountpoint: /var/lib/direct-csi/mnt/e41200e7-beea-430f-b37a-4c380b98fa09
    nodeName: k8s-node-2
    path: /dev/sdg
    physicalBlockSize: 512
    rootPartition: sdg
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 25769803776
    ueventFSUUID: e41200e7-beea-430f-b37a-4c380b98fa09
    vendor: VMware
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIDrive
  metadata:
    creationTimestamp: "2022-01-13T03:56:06Z"
    generation: 1
    labels:
      direct.csi.min.io/access-tier: Unknown
      direct.csi.min.io/created-by: directcsi-driver
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/path: sr0
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:labels:
            .: {}
            f:direct.csi.min.io/access-tier: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/path: {}
            f:direct.csi.min.io/version: {}
        f:spec:
          .: {}
          f:directCSIOwned: {}
        f:status:
          .: {}
          f:accessTier: {}
          f:allocatedCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Formatted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Initialized"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Mounted"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Owned"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:driveStatus: {}
          f:majorNumber: {}
          f:modelNumber: {}
          f:nodeName: {}
          f:path: {}
          f:readOnly: {}
          f:rootPartition: {}
          f:topology:
            .: {}
            f:direct.csi.min.io/identity: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/rack: {}
            f:direct.csi.min.io/region: {}
            f:direct.csi.min.io/zone: {}
          f:totalCapacity: {}
          f:ueventSerial: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T03:56:06Z"
    name: 40d06e7b-d1e4-4a65-a5fc-98ef9eaa160f
    resourceVersion: "3360"
    uid: 01966b82-3634-4415-839c-b404d0e9cbac
  spec:
    directCSIOwned: false
  status:
    accessTier: Unknown
    allocatedCapacity: 1073741312
    conditions:
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Owned
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: NotAdded
      status: "False"
      type: Mounted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: xfs
      reason: NotAdded
      status: "False"
      type: Formatted
    - lastTransitionTime: "2022-01-13T03:56:06Z"
      message: ""
      reason: Initialized
      status: "True"
      type: Initialized
    driveStatus: Unavailable
    majorNumber: 11
    modelNumber: VMware_Virtual_SATA_CDRW_Drive
    nodeName: k8s-node-2
    path: /dev/sr0
    readOnly: true
    rootPartition: sr0
    topology:
      direct.csi.min.io/identity: direct-csi-min-io
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/rack: default
      direct.csi.min.io/region: default
      direct.csi.min.io/zone: default
    totalCapacity: 1073741312
    ueventSerial: "00000000000000000001"
kind: List
metadata: {}

[luckydogxf]

[root@k8s-master-1 ~]# cat /tmp/volumes.yaml
apiVersion: direct.csi.min.io/v1beta3
items:
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIVolume
  metadata:
    creationTimestamp: "2022-01-13T05:50:10Z"
    finalizers:
    - direct.csi.min.io/pv-protection
    - direct.csi.min.io/purge-protection
    generation: 4
    labels:
      direct.csi.min.io/created-by: directcsi-controller
      direct.csi.min.io/drive: 2a736109-c333-4316-a2b1-201f0a86bd88
      direct.csi.min.io/drive-path: sde
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/pod.name: hello-pool-0-2
      direct.csi.min.io/pod.namespace: default
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io/purge-protection": {}
            v:"direct.csi.min.io/pv-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/drive: {}
            f:direct.csi.min.io/drive-path: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/pod.name: {}
            f:direct.csi.min.io/pod.namespace: {}
            f:direct.csi.min.io/version: {}
        f:status:
          .: {}
          f:availableCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Published"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Ready"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Staged"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:containerPath: {}
          f:drive: {}
          f:hostPath: {}
          f:nodeName: {}
          f:stagingPath: {}
          f:totalCapacity: {}
          f:usedCapacity: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:14Z"
    name: pvc-1153ab0b-3201-44d4-95df-5ecff66f8bad
    resourceVersion: "38948"
    uid: d08a803d-aa57-4820-860a-87bd98ab9731
  status:
    availableCapacity: 25165824000
    conditions:
    - lastTransitionTime: "2022-01-13T05:50:10Z"
      message: ""
      reason: InUse
      status: "True"
      type: Staged
    - lastTransitionTime: "2022-01-13T05:50:10Z"
      message: ""
      reason: InUse
      status: "True"
      type: Published
    - lastTransitionTime: "2022-01-13T05:50:10Z"
      message: ""
      reason: Ready
      status: "True"
      type: Ready
    containerPath: /var/lib/kubelet/pods/04ea3bfb-84f5-4164-8726-47ea6ef00683/volumes/kubernetes.io~csi/pvc-1153ab0b-3201-44d4-95df-5ecff66f8bad/mount
    drive: 2a736109-c333-4316-a2b1-201f0a86bd88
    hostPath: /var/lib/direct-csi/mnt/f9c4284f-6bee-4fc9-bf2c-a5f9ad4b802a/pvc-1153ab0b-3201-44d4-95df-5ecff66f8bad
    nodeName: k8s-node-1
    stagingPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-1153ab0b-3201-44d4-95df-5ecff66f8bad/globalmount
    totalCapacity: 25165824000
    usedCapacity: 0
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIVolume
  metadata:
    creationTimestamp: "2022-01-13T05:50:10Z"
    finalizers:
    - direct.csi.min.io/pv-protection
    - direct.csi.min.io/purge-protection
    generation: 3
    labels:
      direct.csi.min.io/created-by: directcsi-controller
      direct.csi.min.io/drive: 40ce7a36-a8ba-44dd-9bf4-a6be0f3d892d
      direct.csi.min.io/drive-path: sdf
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/pod.name: hello-pool-0-2
      direct.csi.min.io/pod.namespace: default
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io/purge-protection": {}
            v:"direct.csi.min.io/pv-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/drive: {}
            f:direct.csi.min.io/drive-path: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/pod.name: {}
            f:direct.csi.min.io/pod.namespace: {}
            f:direct.csi.min.io/version: {}
        f:status:
          .: {}
          f:availableCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Published"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Ready"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Staged"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:containerPath: {}
          f:drive: {}
          f:hostPath: {}
          f:nodeName: {}
          f:stagingPath: {}
          f:totalCapacity: {}
          f:usedCapacity: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:14Z"
    name: pvc-1258d651-d862-429e-b0b3-41b1cbd5f471
    resourceVersion: "38952"
    uid: c9c5899a-1576-4a85-b059-9e90ab01eab8
  status:
    availableCapacity: 25165824000
    conditions:
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Staged
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Published
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: Ready
      status: "True"
      type: Ready
    containerPath: /var/lib/kubelet/pods/04ea3bfb-84f5-4164-8726-47ea6ef00683/volumes/kubernetes.io~csi/pvc-1258d651-d862-429e-b0b3-41b1cbd5f471/mount
    drive: 40ce7a36-a8ba-44dd-9bf4-a6be0f3d892d
    hostPath: /var/lib/direct-csi/mnt/ac8123a9-cf03-4f3a-a4a3-75b5f8491a75/pvc-1258d651-d862-429e-b0b3-41b1cbd5f471
    nodeName: k8s-node-1
    stagingPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-1258d651-d862-429e-b0b3-41b1cbd5f471/globalmount
    totalCapacity: 25165824000
    usedCapacity: 0
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIVolume
  metadata:
    creationTimestamp: "2022-01-13T05:50:10Z"
    finalizers:
    - direct.csi.min.io/pv-protection
    - direct.csi.min.io/purge-protection
    generation: 3
    labels:
      direct.csi.min.io/created-by: directcsi-controller
      direct.csi.min.io/drive: 54cabbc0-e2ac-445b-a65a-ed1757b1122c
      direct.csi.min.io/drive-path: sdf
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/pod.name: hello-pool-0-3
      direct.csi.min.io/pod.namespace: default
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io/purge-protection": {}
            v:"direct.csi.min.io/pv-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/drive: {}
            f:direct.csi.min.io/drive-path: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/pod.name: {}
            f:direct.csi.min.io/pod.namespace: {}
            f:direct.csi.min.io/version: {}
        f:status:
          .: {}
          f:availableCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Published"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Ready"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Staged"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:containerPath: {}
          f:drive: {}
          f:hostPath: {}
          f:nodeName: {}
          f:stagingPath: {}
          f:totalCapacity: {}
          f:usedCapacity: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:13Z"
    name: pvc-29dbbc83-2456-4062-b02a-cc90c377b3ce
    resourceVersion: "38920"
    uid: ab51e50c-7a22-4fae-8f45-280276b3a7b0
  status:
    availableCapacity: 25165824000
    conditions:
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Staged
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Published
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: Ready
      status: "True"
      type: Ready
    containerPath: /var/lib/kubelet/pods/8f615ce3-affa-42ed-ad97-1582aa667a5a/volumes/kubernetes.io~csi/pvc-29dbbc83-2456-4062-b02a-cc90c377b3ce/mount
    drive: 54cabbc0-e2ac-445b-a65a-ed1757b1122c
    hostPath: /var/lib/direct-csi/mnt/5769e9ac-096f-46a9-ae90-347e7596f4a5/pvc-29dbbc83-2456-4062-b02a-cc90c377b3ce
    nodeName: k8s-master-2
    stagingPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-29dbbc83-2456-4062-b02a-cc90c377b3ce/globalmount
    totalCapacity: 25165824000
    usedCapacity: 0
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIVolume
  metadata:
    creationTimestamp: "2022-01-13T05:50:09Z"
    finalizers:
    - direct.csi.min.io/pv-protection
    - direct.csi.min.io/purge-protection
    generation: 5
    labels:
      direct.csi.min.io/created-by: directcsi-controller
      direct.csi.min.io/drive: 1878eada-3cdd-49aa-a2d0-c3683af257b1
      direct.csi.min.io/drive-path: sdf
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/pod.name: hello-pool-0-1
      direct.csi.min.io/pod.namespace: default
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io/purge-protection": {}
            v:"direct.csi.min.io/pv-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/drive: {}
            f:direct.csi.min.io/drive-path: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/pod.name: {}
            f:direct.csi.min.io/pod.namespace: {}
            f:direct.csi.min.io/version: {}
        f:status:
          .: {}
          f:availableCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Published"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Ready"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Staged"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:containerPath: {}
          f:drive: {}
          f:hostPath: {}
          f:nodeName: {}
          f:stagingPath: {}
          f:totalCapacity: {}
          f:usedCapacity: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:14Z"
    name: pvc-407f869b-7a09-42a2-aa85-7a077329815a
    resourceVersion: "44528"
    uid: 432d154f-fae5-44c5-be86-465abf816640
  status:
    availableCapacity: 25165824000
    conditions:
    - lastTransitionTime: "2022-01-13T05:50:10Z"
      message: ""
      reason: InUse
      status: "True"
      type: Staged
    - lastTransitionTime: "2022-01-13T05:50:10Z"
      message: ""
      reason: InUse
      status: "True"
      type: Published
    - lastTransitionTime: "2022-01-13T06:14:33Z"
      message: '[DRIVE LOST] Please refer https://github.com/minio/directpv/blob/master/docs/troubleshooting.md'
      reason: NotReady
      status: "False"
      type: Ready
    containerPath: /var/lib/kubelet/pods/c9db260a-553a-46af-a49a-b954d6f54fd7/volumes/kubernetes.io~csi/pvc-407f869b-7a09-42a2-aa85-7a077329815a/mount
    drive: 1878eada-3cdd-49aa-a2d0-c3683af257b1
    hostPath: /var/lib/direct-csi/mnt/75f44593-a3e4-4aa5-96d6-a2ef4b4e8a71/pvc-407f869b-7a09-42a2-aa85-7a077329815a
    nodeName: k8s-master-1
    stagingPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-407f869b-7a09-42a2-aa85-7a077329815a/globalmount
    totalCapacity: 25165824000
    usedCapacity: 0
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIVolume
  metadata:
    creationTimestamp: "2022-01-13T05:50:09Z"
    finalizers:
    - direct.csi.min.io/pv-protection
    - direct.csi.min.io/purge-protection
    generation: 3
    labels:
      direct.csi.min.io/created-by: directcsi-controller
      direct.csi.min.io/drive: 377ed223-51db-4362-802f-81c93f3ef5c3
      direct.csi.min.io/drive-path: sde
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/pod.name: hello-pool-0-1
      direct.csi.min.io/pod.namespace: default
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io/purge-protection": {}
            v:"direct.csi.min.io/pv-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/drive: {}
            f:direct.csi.min.io/drive-path: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/pod.name: {}
            f:direct.csi.min.io/pod.namespace: {}
            f:direct.csi.min.io/version: {}
        f:status:
          .: {}
          f:availableCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Published"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Ready"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Staged"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:containerPath: {}
          f:drive: {}
          f:hostPath: {}
          f:nodeName: {}
          f:stagingPath: {}
          f:totalCapacity: {}
          f:usedCapacity: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:15Z"
    name: pvc-56674d48-bcd3-4369-9874-a864f3628b2b
    resourceVersion: "38960"
    uid: 189fd34e-dc1e-4b72-84a5-2aa006c02e8a
  status:
    availableCapacity: 25165824000
    conditions:
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Staged
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Published
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: Ready
      status: "True"
      type: Ready
    containerPath: /var/lib/kubelet/pods/c9db260a-553a-46af-a49a-b954d6f54fd7/volumes/kubernetes.io~csi/pvc-56674d48-bcd3-4369-9874-a864f3628b2b/mount
    drive: 377ed223-51db-4362-802f-81c93f3ef5c3
    hostPath: /var/lib/direct-csi/mnt/29652ee5-11f7-400f-a3fe-7032eadae2b8/pvc-56674d48-bcd3-4369-9874-a864f3628b2b
    nodeName: k8s-master-1
    stagingPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-56674d48-bcd3-4369-9874-a864f3628b2b/globalmount
    totalCapacity: 25165824000
    usedCapacity: 0
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIVolume
  metadata:
    creationTimestamp: "2022-01-13T05:50:10Z"
    finalizers:
    - direct.csi.min.io/pv-protection
    - direct.csi.min.io/purge-protection
    generation: 3
    labels:
      direct.csi.min.io/created-by: directcsi-controller
      direct.csi.min.io/drive: d8f51682-5ff9-47ac-a50c-c6615be2b7a0
      direct.csi.min.io/drive-path: sdc
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/pod.name: hello-pool-0-3
      direct.csi.min.io/pod.namespace: default
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io/purge-protection": {}
            v:"direct.csi.min.io/pv-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/drive: {}
            f:direct.csi.min.io/drive-path: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/pod.name: {}
            f:direct.csi.min.io/pod.namespace: {}
            f:direct.csi.min.io/version: {}
        f:status:
          .: {}
          f:availableCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Published"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Ready"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Staged"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:containerPath: {}
          f:drive: {}
          f:hostPath: {}
          f:nodeName: {}
          f:stagingPath: {}
          f:totalCapacity: {}
          f:usedCapacity: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:15Z"
    name: pvc-625f0556-910b-4cab-a088-08ac47a3b44b
    resourceVersion: "38958"
    uid: 31a3bfdf-bd1a-4f4c-a20b-e2acb2a1fdb6
  status:
    availableCapacity: 25165824000
    conditions:
    - lastTransitionTime: "2022-01-13T05:50:10Z"
      message: ""
      reason: InUse
      status: "True"
      type: Staged
    - lastTransitionTime: "2022-01-13T05:50:10Z"
      message: ""
      reason: InUse
      status: "True"
      type: Published
    - lastTransitionTime: "2022-01-13T05:50:10Z"
      message: ""
      reason: Ready
      status: "True"
      type: Ready
    containerPath: /var/lib/kubelet/pods/8f615ce3-affa-42ed-ad97-1582aa667a5a/volumes/kubernetes.io~csi/pvc-625f0556-910b-4cab-a088-08ac47a3b44b/mount
    drive: d8f51682-5ff9-47ac-a50c-c6615be2b7a0
    hostPath: /var/lib/direct-csi/mnt/fe87322c-2a30-4c2e-8b2a-c02c2de8701b/pvc-625f0556-910b-4cab-a088-08ac47a3b44b
    nodeName: k8s-master-2
    stagingPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-625f0556-910b-4cab-a088-08ac47a3b44b/globalmount
    totalCapacity: 25165824000
    usedCapacity: 0
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIVolume
  metadata:
    creationTimestamp: "2022-01-13T05:50:09Z"
    finalizers:
    - direct.csi.min.io/pv-protection
    - direct.csi.min.io/purge-protection
    generation: 3
    labels:
      direct.csi.min.io/created-by: directcsi-controller
      direct.csi.min.io/drive: 4ea9d319-c57e-418a-9629-cc7b60e47be0
      direct.csi.min.io/drive-path: sdd
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/pod.name: hello-pool-0-1
      direct.csi.min.io/pod.namespace: default
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io/purge-protection": {}
            v:"direct.csi.min.io/pv-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/drive: {}
            f:direct.csi.min.io/drive-path: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/pod.name: {}
            f:direct.csi.min.io/pod.namespace: {}
            f:direct.csi.min.io/version: {}
        f:status:
          .: {}
          f:availableCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Published"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Ready"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Staged"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:containerPath: {}
          f:drive: {}
          f:hostPath: {}
          f:nodeName: {}
          f:stagingPath: {}
          f:totalCapacity: {}
          f:usedCapacity: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:15Z"
    name: pvc-6503f872-1e0a-47f2-9bf5-fc94e11ca56f
    resourceVersion: "38973"
    uid: 768ba79a-a148-42cb-80ce-1658f766d81d
  status:
    availableCapacity: 25165824000
    conditions:
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Staged
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Published
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: Ready
      status: "True"
      type: Ready
    containerPath: /var/lib/kubelet/pods/c9db260a-553a-46af-a49a-b954d6f54fd7/volumes/kubernetes.io~csi/pvc-6503f872-1e0a-47f2-9bf5-fc94e11ca56f/mount
    drive: 4ea9d319-c57e-418a-9629-cc7b60e47be0
    hostPath: /var/lib/direct-csi/mnt/31101234-624e-45bb-9896-86819961fa3e/pvc-6503f872-1e0a-47f2-9bf5-fc94e11ca56f
    nodeName: k8s-master-1
    stagingPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-6503f872-1e0a-47f2-9bf5-fc94e11ca56f/globalmount
    totalCapacity: 25165824000
    usedCapacity: 0
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIVolume
  metadata:
    creationTimestamp: "2022-01-13T05:53:12Z"
    finalizers:
    - direct.csi.min.io/pv-protection
    - direct.csi.min.io/purge-protection
    generation: 3
    labels:
      direct.csi.min.io/created-by: directcsi-controller
      direct.csi.min.io/drive: ee98ef05-9c97-4f98-892f-e2e43b344e9c
      direct.csi.min.io/drive-path: sdf
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/pod.name: hello-prometheus-0
      direct.csi.min.io/pod.namespace: default
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io/purge-protection": {}
            v:"direct.csi.min.io/pv-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/drive: {}
            f:direct.csi.min.io/drive-path: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/pod.name: {}
            f:direct.csi.min.io/pod.namespace: {}
            f:direct.csi.min.io/version: {}
        f:status:
          .: {}
          f:availableCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Published"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Ready"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Staged"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:containerPath: {}
          f:drive: {}
          f:hostPath: {}
          f:nodeName: {}
          f:stagingPath: {}
          f:totalCapacity: {}
          f:usedCapacity: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:53:13Z"
    name: pvc-68f6fe63-3d6d-4628-af30-2275f7b09ac0
    resourceVersion: "39814"
    uid: b1cf0ec1-2079-46e3-8346-ab537ca450d5
  status:
    availableCapacity: 5368709120
    conditions:
    - lastTransitionTime: "2022-01-13T05:53:12Z"
      message: ""
      reason: InUse
      status: "True"
      type: Staged
    - lastTransitionTime: "2022-01-13T05:53:12Z"
      message: ""
      reason: InUse
      status: "True"
      type: Published
    - lastTransitionTime: "2022-01-13T05:53:12Z"
      message: ""
      reason: Ready
      status: "True"
      type: Ready
    containerPath: /var/lib/kubelet/pods/62fd7d51-f159-479e-922d-d8410565c3f6/volumes/kubernetes.io~csi/pvc-68f6fe63-3d6d-4628-af30-2275f7b09ac0/mount
    drive: ee98ef05-9c97-4f98-892f-e2e43b344e9c
    hostPath: /var/lib/direct-csi/mnt/83d547c2-cc9c-495a-bd9e-d2d186c2f2f1/pvc-68f6fe63-3d6d-4628-af30-2275f7b09ac0
    nodeName: k8s-node-2
    stagingPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-68f6fe63-3d6d-4628-af30-2275f7b09ac0/globalmount
    totalCapacity: 5368709120
    usedCapacity: 0
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIVolume
  metadata:
    creationTimestamp: "2022-01-13T05:50:10Z"
    finalizers:
    - direct.csi.min.io/pv-protection
    - direct.csi.min.io/purge-protection
    generation: 4
    labels:
      direct.csi.min.io/created-by: directcsi-controller
      direct.csi.min.io/drive: ed7d936c-d63d-437a-9e68-13cb17d104da
      direct.csi.min.io/drive-path: sdd
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/pod.name: hello-pool-0-2
      direct.csi.min.io/pod.namespace: default
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io/purge-protection": {}
            v:"direct.csi.min.io/pv-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/drive: {}
            f:direct.csi.min.io/drive-path: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/pod.name: {}
            f:direct.csi.min.io/pod.namespace: {}
            f:direct.csi.min.io/version: {}
        f:status:
          .: {}
          f:availableCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Published"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Ready"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Staged"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:containerPath: {}
          f:drive: {}
          f:hostPath: {}
          f:nodeName: {}
          f:stagingPath: {}
          f:totalCapacity: {}
          f:usedCapacity: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:16Z"
    name: pvc-72c00d13-27ea-4d98-8b05-ddd6f763808e
    resourceVersion: "38983"
    uid: 5922c624-4d70-4801-9e30-57d920d3db67
  status:
    availableCapacity: 25165824000
    conditions:
    - lastTransitionTime: "2022-01-13T05:50:10Z"
      message: ""
      reason: InUse
      status: "True"
      type: Staged
    - lastTransitionTime: "2022-01-13T05:50:10Z"
      message: ""
      reason: InUse
      status: "True"
      type: Published
    - lastTransitionTime: "2022-01-13T05:50:10Z"
      message: ""
      reason: Ready
      status: "True"
      type: Ready
    containerPath: /var/lib/kubelet/pods/04ea3bfb-84f5-4164-8726-47ea6ef00683/volumes/kubernetes.io~csi/pvc-72c00d13-27ea-4d98-8b05-ddd6f763808e/mount
    drive: ed7d936c-d63d-437a-9e68-13cb17d104da
    hostPath: /var/lib/direct-csi/mnt/a57e01f0-b9bf-4a1b-8f8f-4f7543d47fee/pvc-72c00d13-27ea-4d98-8b05-ddd6f763808e
    nodeName: k8s-node-1
    stagingPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-72c00d13-27ea-4d98-8b05-ddd6f763808e/globalmount
    totalCapacity: 25165824000
    usedCapacity: 0
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIVolume
  metadata:
    creationTimestamp: "2022-01-13T05:50:10Z"
    finalizers:
    - direct.csi.min.io/pv-protection
    - direct.csi.min.io/purge-protection
    generation: 3
    labels:
      direct.csi.min.io/created-by: directcsi-controller
      direct.csi.min.io/drive: b2f44faf-31ae-4515-af18-db00378c147d
      direct.csi.min.io/drive-path: sdg
      direct.csi.min.io/node: k8s-node-1
      direct.csi.min.io/pod.name: hello-pool-0-2
      direct.csi.min.io/pod.namespace: default
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io/purge-protection": {}
            v:"direct.csi.min.io/pv-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/drive: {}
            f:direct.csi.min.io/drive-path: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/pod.name: {}
            f:direct.csi.min.io/pod.namespace: {}
            f:direct.csi.min.io/version: {}
        f:status:
          .: {}
          f:availableCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Published"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Ready"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Staged"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:containerPath: {}
          f:drive: {}
          f:hostPath: {}
          f:nodeName: {}
          f:stagingPath: {}
          f:totalCapacity: {}
          f:usedCapacity: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:15Z"
    name: pvc-783e1034-305b-42c4-9637-2459328c5a51
    resourceVersion: "38966"
    uid: b9a0f510-cd07-4182-9e0b-400166faa699
  status:
    availableCapacity: 25165824000
    conditions:
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Staged
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Published
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: Ready
      status: "True"
      type: Ready
    containerPath: /var/lib/kubelet/pods/04ea3bfb-84f5-4164-8726-47ea6ef00683/volumes/kubernetes.io~csi/pvc-783e1034-305b-42c4-9637-2459328c5a51/mount
    drive: b2f44faf-31ae-4515-af18-db00378c147d
    hostPath: /var/lib/direct-csi/mnt/e09658d1-c996-40c2-b9ac-aa314b981205/pvc-783e1034-305b-42c4-9637-2459328c5a51
    nodeName: k8s-node-1
    stagingPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-783e1034-305b-42c4-9637-2459328c5a51/globalmount
    totalCapacity: 25165824000
    usedCapacity: 0
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIVolume
  metadata:
    creationTimestamp: "2022-01-13T05:50:10Z"
    finalizers:
    - direct.csi.min.io/pv-protection
    - direct.csi.min.io/purge-protection
    generation: 3
    labels:
      direct.csi.min.io/created-by: directcsi-controller
      direct.csi.min.io/drive: 99ba9127-e44b-4896-976c-20b065391590
      direct.csi.min.io/drive-path: sde
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/pod.name: hello-pool-0-3
      direct.csi.min.io/pod.namespace: default
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io/purge-protection": {}
            v:"direct.csi.min.io/pv-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/drive: {}
            f:direct.csi.min.io/drive-path: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/pod.name: {}
            f:direct.csi.min.io/pod.namespace: {}
            f:direct.csi.min.io/version: {}
        f:status:
          .: {}
          f:availableCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Published"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Ready"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Staged"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:containerPath: {}
          f:drive: {}
          f:hostPath: {}
          f:nodeName: {}
          f:stagingPath: {}
          f:totalCapacity: {}
          f:usedCapacity: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:13Z"
    name: pvc-8ac6c63c-cb46-4719-96ab-9adf3ba141f0
    resourceVersion: "38927"
    uid: f98f3604-eced-41bb-88ea-2c98adb4beda
  status:
    availableCapacity: 25165824000
    conditions:
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Staged
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Published
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: Ready
      status: "True"
      type: Ready
    containerPath: /var/lib/kubelet/pods/8f615ce3-affa-42ed-ad97-1582aa667a5a/volumes/kubernetes.io~csi/pvc-8ac6c63c-cb46-4719-96ab-9adf3ba141f0/mount
    drive: 99ba9127-e44b-4896-976c-20b065391590
    hostPath: /var/lib/direct-csi/mnt/55afb26b-24e0-4736-9b3f-a53ee67a18aa/pvc-8ac6c63c-cb46-4719-96ab-9adf3ba141f0
    nodeName: k8s-master-2
    stagingPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-8ac6c63c-cb46-4719-96ab-9adf3ba141f0/globalmount
    totalCapacity: 25165824000
    usedCapacity: 0
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIVolume
  metadata:
    creationTimestamp: "2022-01-13T05:50:10Z"
    finalizers:
    - direct.csi.min.io/pv-protection
    - direct.csi.min.io/purge-protection
    generation: 3
    labels:
      direct.csi.min.io/created-by: directcsi-controller
      direct.csi.min.io/drive: d694dc48-af1a-4cc1-a602-f802c9f0ebec
      direct.csi.min.io/drive-path: sdd
      direct.csi.min.io/node: k8s-master-2
      direct.csi.min.io/pod.name: hello-pool-0-3
      direct.csi.min.io/pod.namespace: default
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io/purge-protection": {}
            v:"direct.csi.min.io/pv-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/drive: {}
            f:direct.csi.min.io/drive-path: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/pod.name: {}
            f:direct.csi.min.io/pod.namespace: {}
            f:direct.csi.min.io/version: {}
        f:status:
          .: {}
          f:availableCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Published"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Ready"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Staged"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:containerPath: {}
          f:drive: {}
          f:hostPath: {}
          f:nodeName: {}
          f:stagingPath: {}
          f:totalCapacity: {}
          f:usedCapacity: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:14Z"
    name: pvc-9e9200f2-ad54-4bf3-9f0d-da4881bd098c
    resourceVersion: "38947"
    uid: d75e4363-a013-44c5-a696-cd2c6a7fda09
  status:
    availableCapacity: 25165824000
    conditions:
    - lastTransitionTime: "2022-01-13T05:50:10Z"
      message: ""
      reason: InUse
      status: "True"
      type: Staged
    - lastTransitionTime: "2022-01-13T05:50:10Z"
      message: ""
      reason: InUse
      status: "True"
      type: Published
    - lastTransitionTime: "2022-01-13T05:50:10Z"
      message: ""
      reason: Ready
      status: "True"
      type: Ready
    containerPath: /var/lib/kubelet/pods/8f615ce3-affa-42ed-ad97-1582aa667a5a/volumes/kubernetes.io~csi/pvc-9e9200f2-ad54-4bf3-9f0d-da4881bd098c/mount
    drive: d694dc48-af1a-4cc1-a602-f802c9f0ebec
    hostPath: /var/lib/direct-csi/mnt/3e36092d-7c44-4520-87ce-b3178229d4af/pvc-9e9200f2-ad54-4bf3-9f0d-da4881bd098c
    nodeName: k8s-master-2
    stagingPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-9e9200f2-ad54-4bf3-9f0d-da4881bd098c/globalmount
    totalCapacity: 25165824000
    usedCapacity: 0
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIVolume
  metadata:
    creationTimestamp: "2022-01-13T05:50:09Z"
    finalizers:
    - direct.csi.min.io/pv-protection
    - direct.csi.min.io/purge-protection
    generation: 3
    labels:
      direct.csi.min.io/created-by: directcsi-controller
      direct.csi.min.io/drive: 1fff922a-7230-4342-a831-e61dc6caeb25
      direct.csi.min.io/drive-path: sdc
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/pod.name: hello-pool-0-0
      direct.csi.min.io/pod.namespace: default
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io/purge-protection": {}
            v:"direct.csi.min.io/pv-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/drive: {}
            f:direct.csi.min.io/drive-path: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/pod.name: {}
            f:direct.csi.min.io/pod.namespace: {}
            f:direct.csi.min.io/version: {}
        f:status:
          .: {}
          f:availableCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Published"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Ready"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Staged"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:containerPath: {}
          f:drive: {}
          f:hostPath: {}
          f:nodeName: {}
          f:stagingPath: {}
          f:totalCapacity: {}
          f:usedCapacity: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:11Z"
    name: pvc-9f09fd4b-c3bf-4c80-9976-562841198950
    resourceVersion: "38849"
    uid: a8b38e7d-13b0-49f6-9f7f-f5d632a602a0
  status:
    availableCapacity: 25165824000
    conditions:
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Staged
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Published
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: Ready
      status: "True"
      type: Ready
    containerPath: /var/lib/kubelet/pods/56cdd9f1-d3b2-4f64-b839-714ac2d0aa06/volumes/kubernetes.io~csi/pvc-9f09fd4b-c3bf-4c80-9976-562841198950/mount
    drive: 1fff922a-7230-4342-a831-e61dc6caeb25
    hostPath: /var/lib/direct-csi/mnt/e85615af-8f9d-4aa8-83cd-4d5fad782660/pvc-9f09fd4b-c3bf-4c80-9976-562841198950
    nodeName: k8s-node-2
    stagingPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-9f09fd4b-c3bf-4c80-9976-562841198950/globalmount
    totalCapacity: 25165824000
    usedCapacity: 0
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIVolume
  metadata:
    creationTimestamp: "2022-01-13T05:50:09Z"
    finalizers:
    - direct.csi.min.io/pv-protection
    - direct.csi.min.io/purge-protection
    generation: 3
    labels:
      direct.csi.min.io/created-by: directcsi-controller
      direct.csi.min.io/drive: f2a06cce-6e21-4931-bee8-21a9bc55bf4c
      direct.csi.min.io/drive-path: sde
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/pod.name: hello-pool-0-0
      direct.csi.min.io/pod.namespace: default
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io/purge-protection": {}
            v:"direct.csi.min.io/pv-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/drive: {}
            f:direct.csi.min.io/drive-path: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/pod.name: {}
            f:direct.csi.min.io/pod.namespace: {}
            f:direct.csi.min.io/version: {}
        f:status:
          .: {}
          f:availableCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Published"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Ready"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Staged"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:containerPath: {}
          f:drive: {}
          f:hostPath: {}
          f:nodeName: {}
          f:stagingPath: {}
          f:totalCapacity: {}
          f:usedCapacity: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:11Z"
    name: pvc-b5df52a4-ba50-4519-935f-4820ad2b5967
    resourceVersion: "38854"
    uid: 8248dd79-af1d-4e35-8dd9-0106786666cd
  status:
    availableCapacity: 25165824000
    conditions:
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Staged
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Published
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: Ready
      status: "True"
      type: Ready
    containerPath: /var/lib/kubelet/pods/56cdd9f1-d3b2-4f64-b839-714ac2d0aa06/volumes/kubernetes.io~csi/pvc-b5df52a4-ba50-4519-935f-4820ad2b5967/mount
    drive: f2a06cce-6e21-4931-bee8-21a9bc55bf4c
    hostPath: /var/lib/direct-csi/mnt/f62b0492-ea40-4972-baf6-7010c8c441f5/pvc-b5df52a4-ba50-4519-935f-4820ad2b5967
    nodeName: k8s-node-2
    stagingPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-b5df52a4-ba50-4519-935f-4820ad2b5967/globalmount
    totalCapacity: 25165824000
    usedCapacity: 0
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIVolume
  metadata:
    creationTimestamp: "2022-01-13T05:50:09Z"
    finalizers:
    - direct.csi.min.io/pv-protection
    - direct.csi.min.io/purge-protection
    generation: 3
    labels:
      direct.csi.min.io/created-by: directcsi-controller
      direct.csi.min.io/drive: 0ebe5360-98d4-4172-a52e-7a4290608236
      direct.csi.min.io/drive-path: sdc
      direct.csi.min.io/node: k8s-master-1
      direct.csi.min.io/pod.name: hello-pool-0-1
      direct.csi.min.io/pod.namespace: default
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io/purge-protection": {}
            v:"direct.csi.min.io/pv-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/drive: {}
            f:direct.csi.min.io/drive-path: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/pod.name: {}
            f:direct.csi.min.io/pod.namespace: {}
            f:direct.csi.min.io/version: {}
        f:status:
          .: {}
          f:availableCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Published"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Ready"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Staged"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:containerPath: {}
          f:drive: {}
          f:hostPath: {}
          f:nodeName: {}
          f:stagingPath: {}
          f:totalCapacity: {}
          f:usedCapacity: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:14Z"
    name: pvc-bce70e31-43b8-4192-ba99-438280b5a5a7
    resourceVersion: "38946"
    uid: 6b7b839a-0b3d-4ee2-af48-bc8df4f4cb5e
  status:
    availableCapacity: 25165824000
    conditions:
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Staged
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Published
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: Ready
      status: "True"
      type: Ready
    containerPath: /var/lib/kubelet/pods/c9db260a-553a-46af-a49a-b954d6f54fd7/volumes/kubernetes.io~csi/pvc-bce70e31-43b8-4192-ba99-438280b5a5a7/mount
    drive: 0ebe5360-98d4-4172-a52e-7a4290608236
    hostPath: /var/lib/direct-csi/mnt/f3f941a1-8604-4098-8b4b-48c46c8e2be9/pvc-bce70e31-43b8-4192-ba99-438280b5a5a7
    nodeName: k8s-master-1
    stagingPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-bce70e31-43b8-4192-ba99-438280b5a5a7/globalmount
    totalCapacity: 25165824000
    usedCapacity: 0
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIVolume
  metadata:
    creationTimestamp: "2022-01-13T05:50:09Z"
    finalizers:
    - direct.csi.min.io/pv-protection
    - direct.csi.min.io/purge-protection
    generation: 3
    labels:
      direct.csi.min.io/created-by: directcsi-controller
      direct.csi.min.io/drive: 41484724-341c-46db-830f-b24a2c15aec4
      direct.csi.min.io/drive-path: sdd
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/pod.name: hello-pool-0-0
      direct.csi.min.io/pod.namespace: default
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io/purge-protection": {}
            v:"direct.csi.min.io/pv-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/drive: {}
            f:direct.csi.min.io/drive-path: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/pod.name: {}
            f:direct.csi.min.io/pod.namespace: {}
            f:direct.csi.min.io/version: {}
        f:status:
          .: {}
          f:availableCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Published"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Ready"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Staged"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:containerPath: {}
          f:drive: {}
          f:hostPath: {}
          f:nodeName: {}
          f:stagingPath: {}
          f:totalCapacity: {}
          f:usedCapacity: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:12Z"
    name: pvc-d8d24739-794c-4f2e-84dc-5c64b31dbebc
    resourceVersion: "38873"
    uid: f58e50d4-ece7-4740-a6b7-1c1e8fa4cf19
  status:
    availableCapacity: 25165824000
    conditions:
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Staged
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Published
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: Ready
      status: "True"
      type: Ready
    containerPath: /var/lib/kubelet/pods/56cdd9f1-d3b2-4f64-b839-714ac2d0aa06/volumes/kubernetes.io~csi/pvc-d8d24739-794c-4f2e-84dc-5c64b31dbebc/mount
    drive: 41484724-341c-46db-830f-b24a2c15aec4
    hostPath: /var/lib/direct-csi/mnt/ac3b26e1-f844-456d-95d6-b760d58a3c67/pvc-d8d24739-794c-4f2e-84dc-5c64b31dbebc
    nodeName: k8s-node-2
    stagingPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-d8d24739-794c-4f2e-84dc-5c64b31dbebc/globalmount
    totalCapacity: 25165824000
    usedCapacity: 0
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIVolume
  metadata:
    creationTimestamp: "2022-01-13T05:50:09Z"
    finalizers:
    - direct.csi.min.io/pv-protection
    - direct.csi.min.io/purge-protection
    generation: 3
    labels:
      direct.csi.min.io/created-by: directcsi-controller
      direct.csi.min.io/drive: 07161aca-0b78-4531-861d-7bfee05d0995
      direct.csi.min.io/drive-path: sdg
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/pod.name: hello-pool-0-0
      direct.csi.min.io/pod.namespace: default
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io/purge-protection": {}
            v:"direct.csi.min.io/pv-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/drive: {}
            f:direct.csi.min.io/drive-path: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/pod.name: {}
            f:direct.csi.min.io/pod.namespace: {}
            f:direct.csi.min.io/version: {}
        f:status:
          .: {}
          f:availableCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Published"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Ready"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Staged"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:containerPath: {}
          f:drive: {}
          f:hostPath: {}
          f:nodeName: {}
          f:stagingPath: {}
          f:totalCapacity: {}
          f:usedCapacity: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:50:12Z"
    name: pvc-dddba84b-3473-4441-b49f-b24ff38132e3
    resourceVersion: "38890"
    uid: 417de402-7413-41b3-a09f-6bbf2d465c9e
  status:
    availableCapacity: 25165824000
    conditions:
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Staged
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: InUse
      status: "True"
      type: Published
    - lastTransitionTime: "2022-01-13T05:50:09Z"
      message: ""
      reason: Ready
      status: "True"
      type: Ready
    containerPath: /var/lib/kubelet/pods/56cdd9f1-d3b2-4f64-b839-714ac2d0aa06/volumes/kubernetes.io~csi/pvc-dddba84b-3473-4441-b49f-b24ff38132e3/mount
    drive: 07161aca-0b78-4531-861d-7bfee05d0995
    hostPath: /var/lib/direct-csi/mnt/e41200e7-beea-430f-b37a-4c380b98fa09/pvc-dddba84b-3473-4441-b49f-b24ff38132e3
    nodeName: k8s-node-2
    stagingPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-dddba84b-3473-4441-b49f-b24ff38132e3/globalmount
    totalCapacity: 25165824000
    usedCapacity: 0
- apiVersion: direct.csi.min.io/v1beta3
  kind: DirectCSIVolume
  metadata:
    creationTimestamp: "2022-01-13T05:52:12Z"
    finalizers:
    - direct.csi.min.io/pv-protection
    - direct.csi.min.io/purge-protection
    generation: 3
    labels:
      direct.csi.min.io/created-by: directcsi-controller
      direct.csi.min.io/drive: ee98ef05-9c97-4f98-892f-e2e43b344e9c
      direct.csi.min.io/drive-path: sdf
      direct.csi.min.io/node: k8s-node-2
      direct.csi.min.io/pod.name: hello-log-0
      direct.csi.min.io/pod.namespace: default
      direct.csi.min.io/version: v1beta3
    managedFields:
    - apiVersion: direct.csi.min.io/v1beta3
      fieldsType: FieldsV1
      fieldsV1:
        f:metadata:
          f:finalizers:
            .: {}
            v:"direct.csi.min.io/purge-protection": {}
            v:"direct.csi.min.io/pv-protection": {}
          f:labels:
            .: {}
            f:direct.csi.min.io/created-by: {}
            f:direct.csi.min.io/drive: {}
            f:direct.csi.min.io/drive-path: {}
            f:direct.csi.min.io/node: {}
            f:direct.csi.min.io/pod.name: {}
            f:direct.csi.min.io/pod.namespace: {}
            f:direct.csi.min.io/version: {}
        f:status:
          .: {}
          f:availableCapacity: {}
          f:conditions:
            .: {}
            k:{"type":"Published"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Ready"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
            k:{"type":"Staged"}:
              .: {}
              f:lastTransitionTime: {}
              f:message: {}
              f:reason: {}
              f:status: {}
              f:type: {}
          f:containerPath: {}
          f:drive: {}
          f:hostPath: {}
          f:nodeName: {}
          f:stagingPath: {}
          f:totalCapacity: {}
          f:usedCapacity: {}
      manager: directpv
      operation: Update
      time: "2022-01-13T05:52:13Z"
    name: pvc-ec6e9d77-ee37-4bc7-91a7-bd48dec5285a
    resourceVersion: "39514"
    uid: b5c7ae03-09d9-4930-a3a6-2282a26a4ddb
  status:
    availableCapacity: 5368709120
    conditions:
    - lastTransitionTime: "2022-01-13T05:52:12Z"
      message: ""
      reason: InUse
      status: "True"
      type: Staged
    - lastTransitionTime: "2022-01-13T05:52:12Z"
      message: ""
      reason: InUse
      status: "True"
      type: Published
    - lastTransitionTime: "2022-01-13T05:52:12Z"
      message: ""
      reason: Ready
      status: "True"
      type: Ready
    containerPath: /var/lib/kubelet/pods/88ea34af-814e-47f7-9959-60379ce8bc31/volumes/kubernetes.io~csi/pvc-ec6e9d77-ee37-4bc7-91a7-bd48dec5285a/mount
    drive: ee98ef05-9c97-4f98-892f-e2e43b344e9c
    hostPath: /var/lib/direct-csi/mnt/83d547c2-cc9c-495a-bd9e-d2d186c2f2f1/pvc-ec6e9d77-ee37-4bc7-91a7-bd48dec5285a
    nodeName: k8s-node-2
    stagingPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/pvc-ec6e9d77-ee37-4bc7-91a7-bd48dec5285a/globalmount
    totalCapacity: 5368709120
    usedCapacity: 0
kind: List
metadata: {}

[Praveenrajmani]

looks like the PV pvc-29dbbc83-2456-4062-b02a-cc90c377b3ce is still in use. you need to clear it as well @luckydogxf

[luckydogxf]

okay, appreciated, how to determine this pv is still in use? One more thing, 24 x 16G =384G so I cannot use all of them? Something pre-allocated ?

[Praveenrajmani]

how to determine this pv is still in use?

w.r.t directpv, if a directpv volume is staged and published, it means the volume is still in use by the workload.

we can use volumes subcommand to list staged and published volumes.

kubectl directpv volumes ls --status=staged,published
kubectl directpv volumes ls --status=staged,published -- nodes <node_selector> --drives <drive_selector>

please refer kubectl directpv volumes list --help for more helpers.

One more thing, 24 x 16G =384G so I cannot use all of them? Something pre-allocated ?

The values displayed in drives listing are humanized and rounded up. you need to look into the actual drive manifests to know the accurate values.

kubectl directpv drives list --nodes <node_selector> --drives <drive_selector> -o yaml can show you the actual values.

For eg,

driveStatus: Ready
filesystem: xfs
filesystemUUID: c7842b85-e533-41b0-814d-ab2a93563a52
**freeCapacity: 25723416576**
logicalBlockSize: 512
majorNumber: 8
minorNumber: 32
modelNumber: Virtual_disk
mountpoint: /var/lib/direct-csi/mnt/c7842b85-e533-41b0-814d-ab2a93563a52
nodeName: k8s-node-1
path: /dev/sdc
physicalBlockSize: 512
rootPartition: sdc

Something pre-allocated

There should be some internal metadata space in each drive. This is what you basically see as allocated capacity in Available drives

[luckydogxf]

Pretty weird.

[root@k8s-master-1 ~]# kubectl directpv volumes list --drives /dev/sdc --nodes k8s-master-2 --all
 VOLUME                                    CAPACITY  NODE                               DRIVE  PODNAME          PODNAMESPACE                                                                                  
 pvc-aed73bbc-638b-4810-9b11-2eff633cb7ab  23 GiB    k8s-master-2  sdc    hongquan-ss-0-0  default       *[DRIVE LOST] Please refer https://github.com/minio/directpv/blob/master/docs/troubleshooting.md

# already gone.
[root@k8s-master-1 ~]# kubectl get pv pvc-aed73bbc-638b-4810-9b11-2eff633cb7ab
Error from server (NotFound): persistentvolumes "pvc-aed73bbc-638b-4810-9b11-2eff633cb7ab" not found

[root@k8s-master-1 ~]# kubectl directpv drives list --status="terminating"
 DRIVE     CAPACITY  ALLOCATED  FILESYSTEM  VOLUMES  NODE                               ACCESS-TIER  STATUS
 /dev/sdc  24 GiB    24 GiB     xfs         1        k8s-master-2  -            Terminating

I removed /dev/sdc of k8s-master-2, and remove related PV/PVC. Now it's still in Terminating.

[Praveenrajmani]

you shouldn't be removing PVs directly @luckydogxf. you just need to remove the corresponding PVC.

kubectl directpv volumes list --drives /dev/sdc --nodes k8s-master-2 --all -o yaml
kubectl directpv drives list --drives /dev/sdc --nodes k8s-master-2 --all -o yaml

can you paste the output of this ^^ @luckydogxf

[Praveenrajmani]

kubectl directpv volumes list --drives /dev/sdc --nodes k8s-master-2 --all -o yaml

as PV was directly removed, you need to manually delete this directpv volume after removing the direct.csi.min.io/pv-protection finalizer.

Just do kubectl delete directcsivolume <volume_id> after removing the finalizer direct.csi.min.io/pv-protection

this will release the volume and clean up the terminating drive

[luckydogxf]

Yea, using kubectl delete directcsivolume <volume_id> could get rid of pv of directscivolume

Below line gets rid of

pvc-aed73bbc-638b-4810-9b11-2eff633cb7ab  23 GiB    k8s-master-2.pacific-textiles.com  sdc    hongquan-ss-0-0  default       *[DRIVE LOST] Please refer https://github.com/minio/directpv/blob/master/docs/troubleshooting.md

However kubectl directpv drive ls | grep Terminating still shows /dev/sdc of k8s-master-2 is stuck in terminating.

/dev/sdc   24 GiB    24 GiB     xfs         1        k8s-master-2  -            Terminating

Okay, just realize that directcsidrive needs to be removed accrodingly.

 kubectl directpv drives list --drives /dev/sdc --nodes k8s-master-2 --status=Terminating -o yaml| grep name -i

gets uuid. Then ` kubectl edit directcsidrives.direct.csi.min.io <UUID_from_previous_command> , remove lines after finalizer to get rid of protection.

Now it's okay, I can add my new disks and format them, join them to pools.

@Praveenrajmani Thanks a lot.

[luckydogxf]

One thing that's not import, but annoying. My Minio is back, but this information is still there. How to get rid of it ?

pvc-49d41569-edb2-48ad-ae92-8116162d3b51  23 GiB    k8s-node    sdd    ptl-pool-0-1      minio-operator  *[DRIVE LOST] Please refer https://github.com/minio/directpv/blob/master/docs/troubleshooting.md

@Praveenrajmani

[Praveenrajmani]

just these steps should be enough - https://github.com/minio/directpv/issues/505#issuecomment-1012041317

manually modifying the CRDs are not recommended for other cases, and may lead to situations like these that you see.