search

juicedata / juicefs-csi-driver

JuiceFS CSI Driver
https://github.com/juicedata/juicefs
Apache License 2.0
218 stars 82 forks source link

[QUESTION] How to solve these problems?(create and use PV) #973

Open BetterManXJS opened 3 months ago

BetterManXJS commented 3 months ago

Question

kubectl logs juicefs-hpc-master-pvc-5465ef2b-1a8c-4456-be67-6998fa3d58e4-lentka -n juicefs ---> object storage: Can't read default config file: rados: ret=2, No such file or directory [format.go:469] database is not formatted, please run juicefs format ... first [main.go:31]

What help did you want: create and use PV

Environment:

juicefs-csi-log

zwwhdls commented 3 months ago

Please refer to this doc: https://juicefs.com/docs/csi/ceph

BetterManXJS commented 3 months ago

Please refer to this doc: https://juicefs.com/docs/csi/ceph

i tried it step by step, but new problem occured

some logs are here，please take a look，thank you~

root@hpc-node-1:/home/xjs/jiaocheng# kubectl get pods -n juicefs
NAME                                                                 READY   STATUS              RESTARTS          AGE
juicefs-app                                                          0/1     ContainerCreating   0                 150m
juicefs-csi-controller-0                                             3/3     Running             243 (5d18h ago)   6d20h
juicefs-csi-controller-1                                             3/3     Running             1 (27h ago)       27h
juicefs-csi-dashboard-7f7c45fc6c-5kmm6                               1/1     Running             0                 6d20h
juicefs-csi-node-2cf4s                                               3/3     Running             290 (5d18h ago)   6d20h
juicefs-csi-node-hmmng                                               3/3     Running             298 (6d2h ago)    6d20h
juicefs-csi-node-j6dlt                                               3/3     Running             279 (6d4h ago)    6d20h
juicefs-csi-node-m2w25                                               3/3     Running             285 (20h ago)     6d20h
juicefs-hpc-master-pvc-02117cb7-f90d-4efc-a9cc-d1450a26c8d6-exacfo   0/1     CrashLoopBackOff    34 (44s ago)      150m
root@hpc-node-1:/home/xjs/jiaocheng# kubectl logs juicefs-hpc-master-pvc-02117cb7-f90d-4efc-a9cc-d1450a26c8d6-exacfo -n juicefs
2024/06/12 06:14:11.249488 juicefs[7] <INFO>: Meta address: redis://10.110.163.22:6379/2 [interface.go:497]
2024/06/12 06:14:11.251232 juicefs[7] <WARNING>: AOF is not enabled, you may lose data if Redis is not shutdown properly. [info.go:84]
2024/06/12 06:14:11.251477 juicefs[7] <INFO>: Ping redis latency: 185.426µs [redis.go:3600]
unable to parse addrs in '[v2:10.110.163.34:3300/0,v1:10.110.163.34:6789/0] [v2:10.110.163.35:3300/0,v1:10.110.163.35:6789/0] [v2:10.110.163.23:3300/0,v1:10.110.163.23:6789/0] [v2:10.110.163.74:3300/0,v1:10.110.163.74:6789/0] [v2:10.110.163.22:3300/0,v1:10.110.163.22:6789/0]'
2024/06/12 06:14:11.262391 juicefs[7] <FATAL>: object storage: Can't connect to cluster ceph: rados: ret=22, Invalid argument [format.go:469]
server name not found: [v2:10.110.163.34:3300/0 (Name or service not known)
2024/06/12 06:14:11.834072 juicefs[29] <INFO>: Meta address: redis://10.110.163.22:6379/2 [interface.go:497]
2024/06/12 06:14:11.835791 juicefs[29] <WARNING>: AOF is not enabled, you may lose data if Redis is not shutdown properly. [info.go:84]
2024/06/12 06:14:11.836073 juicefs[29] <INFO>: Ping redis latency: 184.361µs [redis.go:3600]
unable to parse addrs in '[v2:10.110.163.34:3300/0,v1:10.110.163.34:6789/0] [v2:10.110.163.35:3300/0,v1:10.110.163.35:6789/0] [v2:10.110.163.23:3300/0,v1:10.110.163.23:6789/0] [v2:10.110.163.74:3300/0,v1:10.110.163.74:6789/0] [v2:10.110.163.22:3300/0,v1:10.110.163.22:6789/0]'
2024/06/12 06:14:11.851185 juicefs[29] <FATAL>: object storage: Can't connect to cluster ceph: rados: ret=22, Invalid argument [main.go:31]
server name not found: [v2:10.110.163.34:3300/0 (Name or service not known)
root@hpc-node-1:/home/xjs/jiaocheng# ./csi-doctor.sh debug juicefs-app -n juicefs
CSI Controller Image: 
Application Pod Event
LAST SEEN   TYPE      REASON        OBJECT            MESSAGE
15m         Warning   FailedMount   pod/juicefs-app   Unable to attach or mount volumes: unmounted volumes=[juicefs-pv], unattached volumes=[juicefs-pv kube-api-access-wssvv]: timed out waiting for the condition
5m4s        Warning   FailedMount   pod/juicefs-app   Unable to attach or mount volumes: unmounted volumes=[juicefs-pv], unattached volumes=[kube-api-access-wssvv juicefs-pv]: timed out waiting for the condition
10m         Warning   FailedMount   pod/juicefs-app   (combined from similar events): MountVolume.SetUp failed for volume "pvc-02117cb7-f90d-4efc-a9cc-d1450a26c8d6" : rpc error: code = Internal desc = Could not mount juicefs: mount redis://10.110.163.22:6379/2 at /jfs/pvc-02117cb7-f90d-4efc-a9cc-d1450a26c8d6-exacfo failed, mountpod: juicefs-hpc-master-pvc-02117cb7-f90d-4efc-a9cc-d1450a26c8d6-exacfo, failed log: 2024/06/12 06:03:58.238218 juicefs[7] <INFO>: Meta address: redis://10.110.163.22:6379/2 [interface.go:497]...