hwameistor / hwameistor

Hwameistor is an HA local storage system for cloud-native stateful workloads.
https://hwameistor.io/
Apache License 2.0
557 stars 76 forks source link

with the latest version 0.10.1 of hwameistor-operator not working properly in the Huawei Cloud CCE #874

Closed samzong closed 1 year ago

samzong commented 1 year ago

Output of lsblk:

# paste output here
[root@hwctest-01-wk01 ~]# lsblk
NAME                MAJ:MIN RM  SIZE RO TYPE MOUNTPOINT
vda                 253:0    0   50G  0 disk
└─vda1              253:1    0   50G  0 part /
vdb                 253:16   0  150G  0 disk
vdc                 253:32   0  100G  0 disk
├─vgpaas-dockersys  252:0    0   90G  0 lvm  /var/lib/docker
└─vgpaas-kubernetes 252:1    0   10G  0 lvm  /mnt/paas/kubernetes/kubelet

Output of blkid:

# paste output here
[root@hwctest-01-wk01 ~]# blkid
/dev/vda1: UUID="6f4ab921-3369-44a2-bda4-ee8ffa1ba0dc" TYPE="ext4"
/dev/vdb: UUID="mYNIMY-PjEe-bQUT-iOTB-AzMp-wYF1-kY3bky" TYPE="LVM2_member"
/dev/mapper/vgpaas-dockersys: UUID="e5477d5f-6c30-4aa8-9246-bf2298432745" TYPE="ext4"
/dev/vdc: UUID="sXo2il-2Mid-8sUM-F7JC-2nWS-U8I5-2XKJRz" TYPE="LVM2_member"
/dev/mapper/vgpaas-kubernetes: UUID="40591679-3b07-43c4-8ca2-91b80c51f604" TYPE="ext4"

Output of kubectl version:

# paste output here
WARNING: This version information is deprecated and will be replaced with the output from kubectl version --short.  Use --output=yaml|json to get the full version.
Client Version: version.Info{Major:"1", Minor:"25", GitVersion:"v1.25.3", GitCommit:"434bfd82814af038ad94d62ebe59b133fcb50506", GitTreeState:"clean", BuildDate:"2022-10-12T10:57:26Z", GoVersion:"go1.19.2", Compiler:"gc", Platform:"linux/amd64"}
Kustomize Version: v4.5.7
Server Version: version.Info{Major:"1", Minor:"25+", GitVersion:"v1.25.3-r0-25.2.19", GitCommit:"b2f920e260f848bbc81a9b7480eec8a318f2e4e1", GitTreeState:"clean", BuildDate:"2023-04-11T06:22:46Z", GoVersion:"go1.19.4", Compiler:"gc", Platform:"linux/amd64"}

Output of kubectl get lsn -o yaml:

# paste output here
apiVersion: v1
items:
- apiVersion: hwameistor.io/v1alpha1
  kind: LocalStorageNode
  metadata:
    creationTimestamp: "2023-05-24T17:13:21Z"
    generation: 1
    name: 192.168.1.77
    resourceVersion: "449291"
    uid: 6a237aa7-a031-4a73-b7c1-ce075ffa8a57
  spec:
    hostname: 192.168.1.77
    storageIP: 192.168.1.77
    topogoly:
      region: default
      zone: default
  status:
    conditions:
    - lastTransitionTime: "2023-05-25T02:19:25Z"
      lastUpdateTime: "2023-05-25T02:19:25Z"
      message: Successfully to expand storage capacity
      reason: StorageExpandSuccess
      status: "True"
      type: ExpandSuccess
    poolExtendRecords:
      LocalStorage_PoolHDD:
      - description:
          diskType: HDD
        diskRefs:
        - apiVersion: hwameistor.io/v1alpha1
          kind: LocalDisk
          name: 192-168-1-77-vdc
          resourceVersion: "449241"
          uid: 0caacd95-12e1-43b3-8962-f0bd22ab9010
        nodeName: 192.168.1.77
        owner: local-storage
    pools:
      LocalStorage_PoolHDD:
        class: HDD
        disks:
        - capacityBytes: 161057079296
          devPath: /dev/vdc
          state: InUse
          type: HDD
        freeCapacityBytes: 161057079296
        freeVolumeCount: 1000
        name: LocalStorage_PoolHDD
        totalCapacityBytes: 161057079296
        totalVolumeCount: 1000
        type: REGULAR
        usedCapacityBytes: 0
        usedVolumeCount: 0
        volumeCapacityBytesLimit: 161057079296
    state: Ready
- apiVersion: hwameistor.io/v1alpha1
  kind: LocalStorageNode
  metadata:
    creationTimestamp: "2023-05-24T17:27:09Z"
    generation: 1
    name: 192.168.13.51
    resourceVersion: "486020"
    uid: 4eea3ba4-51ab-4ef9-94b8-899b3175e19a
  spec:
    hostname: 192.168.13.51
    storageIP: 192.168.13.51
    topogoly:
      region: default
      zone: default
  status:
    conditions:
    - lastTransitionTime: "2023-05-25T02:19:25Z"
      lastUpdateTime: "2023-05-25T02:19:25Z"
      message: Successfully to expand storage capacity
      reason: StorageExpandSuccess
      status: "True"
      type: ExpandSuccess
    poolExtendRecords:
      LocalStorage_PoolHDD:
      - description:
          diskType: HDD
        diskRefs:
        - apiVersion: hwameistor.io/v1alpha1
          kind: LocalDisk
          name: 192-168-13-51-vdc
          resourceVersion: "449230"
          uid: fe2fb054-0869-40a9-81ef-38fd53ad38f2
        nodeName: 192.168.13.51
        owner: local-storage
    pools:
      LocalStorage_PoolHDD:
        class: HDD
        disks:
        - capacityBytes: 161057079296
          devPath: /dev/vdc
          state: InUse
          type: HDD
        freeCapacityBytes: 159983337472
        freeVolumeCount: 999
        name: LocalStorage_PoolHDD
        totalCapacityBytes: 161057079296
        totalVolumeCount: 1000
        type: REGULAR
        usedCapacityBytes: 1073741824
        usedVolumeCount: 1
        volumeCapacityBytesLimit: 161057079296
        volumes:
        - pvc-93ba6c58-d71a-4901-b9f4-81670e5cde9c
    state: Ready
- apiVersion: hwameistor.io/v1alpha1
  kind: LocalStorageNode
  metadata:
    creationTimestamp: "2023-05-24T17:43:22Z"
    generation: 1
    name: 192.168.7.134
    resourceVersion: "449289"
    uid: 624aa54c-a1ac-4abc-a9d5-908dadcc6656
  spec:
    hostname: 192.168.7.134
    storageIP: 192.168.7.134
    topogoly:
      region: default
      zone: default
  status:
    conditions:
    - lastTransitionTime: "2023-05-25T02:19:25Z"
      lastUpdateTime: "2023-05-25T02:19:25Z"
      message: Successfully to expand storage capacity
      reason: StorageExpandSuccess
      status: "True"
      type: ExpandSuccess
    poolExtendRecords:
      LocalStorage_PoolHDD:
      - description:
          diskType: HDD
        diskRefs:
        - apiVersion: hwameistor.io/v1alpha1
          kind: LocalDisk
          name: 192-168-7-134-vdb
          resourceVersion: "449257"
          uid: bd403dcf-7d3b-411c-a168-4d19e2436015
        nodeName: 192.168.7.134
        owner: local-storage
    pools:
      LocalStorage_PoolHDD:
        class: HDD
        disks:
        - capacityBytes: 161057079296
          devPath: /dev/vdb
          state: InUse
          type: HDD
        freeCapacityBytes: 161057079296
        freeVolumeCount: 1000
        name: LocalStorage_PoolHDD
        totalCapacityBytes: 161057079296
        totalVolumeCount: 1000
        type: REGULAR
        usedCapacityBytes: 0
        usedVolumeCount: 0
        volumeCapacityBytesLimit: 161057079296
    state: Ready
kind: List
metadata:
  resourceVersion: ""

Cloud Provider/Platform (AKS, GKE, Minikube etc.):

# paste output here
HuaweiCloud CCE

I'm using kubectl get ldn and I noticed that the status I'm getting is always Offline. I've tried syncing the time for all services but the issue persists.

Can you help me troubleshoot this problem?

Looking forward to your reply.

SSmallMonster commented 1 year ago

@SAMZONG Thanks for your feedback.

It was confirmed that this was caused by a bug caused by node names containing periods and has been fixed.