search

opencurve / curve

Curve is a sandbox project hosted by the CNCF Foundation. It's cloud-native, high-performance, and easy to operate. Curve is an open-source distributed storage system for block and shared file storage.
https://opencurve.io
Apache License 2.0
2.33k stars 522 forks source link

多机部署失败 #663

Closed wavemomo closed 2 years ago

wavemomo commented 3 years ago

General Question

当我严格按照多机部署的步骤来做时，一直会出现以下错误：

TASK [prepare_software_env : determine if lib installed with dpkg] ***** fatal: [etcd1]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.040669", "end": "2021-11-11 20:08:14.231956", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.191287", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [server3]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.035415", "end": "2021-11-11 20:08:14.239019", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.203604", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [etcd3]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.032685", "end": "2021-11-11 20:08:14.236221", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.203536", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [etcd2]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.038535", "end": "2021-11-11 20:08:14.262965", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.224430", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [server2]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.038260", "end": "2021-11-11 20:08:14.286815", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.248555", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [snap1]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.041670", "end": "2021-11-11 20:08:14.580239", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.538569", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [snap3]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.035681", "end": "2021-11-11 20:08:14.626929", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.591248", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [mds1]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.041791", "end": "2021-11-11 20:08:14.627745", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.585954", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [snap2]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.044270", "end": "2021-11-11 20:08:14.615993", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.571723", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [mds2]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.047527", "end": "2021-11-11 20:08:14.658510", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.610983", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [mds3]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.038690", "end": "2021-11-11 20:08:14.944898", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.906208", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [localhost]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.037397", "end": "2021-11-11 20:08:14.962699", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.925302", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [server1]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.038511", "end": "2021-11-11 20:08:15.027817", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.989306", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [nginx1]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.036311", "end": "2021-11-11 20:08:15.034947", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.998636", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [nginx2]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.035823", "end": "2021-11-11 20:08:15.032724", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.996901", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring

TASK [prepare_software_env : install lib with apt] ***** [WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo

fatal: [server2]: FAILED! => {"changed": true, "cmd": "sudo apt-get -y install podlators-perl", "delta": "0:00:00.286608", "end": "2021-11-11 20:08:15.746122", "msg": "non-zero return code", "rc": 100, "start": "2021-11-11 20:08:15.459514", "stderr": "E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable)\nE: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it?", "stderr_lines": ["E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable)", "E: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it?"], "stdout": "", "stdout_lines": []} changed: [etcd3] changed: [etcd2] changed: [etcd1] fatal: [mds1]: FAILED! => {"changed": true, "cmd": "sudo apt-get -y install podlators-perl", "delta": "0:00:00.083557", "end": "2021-11-11 20:08:16.313183", "msg": "non-zero return code", "rc": 100, "start": "2021-11-11 20:08:16.229626", "stderr": "E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable)\nE: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it?", "stderr_lines": ["E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable)", "E: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it?"], "stdout": "", "stdout_lines": []} changed: [snap2] changed: [snap1] changed: [mds2] changed: [mds3] changed: [localhost] fatal: [nginx1]: FAILED! => {"changed": true, "cmd": "sudo apt-get -y install podlators-perl", "delta": "0:00:00.078826", "end": "2021-11-11 20:08:17.809896", "msg": "non-zero return code", "rc": 100, "start": "2021-11-11 20:08:17.731070", "stderr": "E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable)\nE: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it?", "stderr_lines": ["E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable)", "E: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it?"], "stdout": "", "stdout_lines": []} changed: [server1] changed: [nginx2] changed: [server3] changed: [snap3]

NO MORE HOSTS LEFT ***** to retry, use: --limit @/home/curve/curve/curve-ansible/deploy_curve.retry

PLAY RECAP ***** etcd1 : ok=30 changed=8 unreachable=0 failed=0
etcd2 : ok=30 changed=8 unreachable=0 failed=0
etcd3 : ok=30 changed=8 unreachable=0 failed=0
localhost : ok=31 changed=8 unreachable=0 failed=0
mds1 : ok=29 changed=7 unreachable=0 failed=1
mds2 : ok=30 changed=8 unreachable=0 failed=0
mds3 : ok=30 changed=8 unreachable=0 failed=0
nginx1 : ok=29 changed=7 unreachable=0 failed=1
nginx2 : ok=30 changed=8 unreachable=0 failed=0
server1 : ok=32 changed=8 unreachable=0 failed=0
server2 : ok=31 changed=7 unreachable=0 failed=1
server3 : ok=32 changed=8 unreachable=0 failed=0
snap1 : ok=30 changed=8 unreachable=0 failed=0
snap2 : ok=30 changed=8 unreachable=0 failed=0
snap3 : ok=30 changed=8 unreachable=0 failed=0

我做过很多尝试，但都无法解决这个问题

Cyber-SiKu commented 3 years ago

General Question

当我严格按照多机部署的步骤来做时，一直会出现以下错误：

TASK [prepare_software_env : determine if lib installed with dpkg] ***** fatal: [etcd1]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.040669", "end": "2021-11-11 20:08:14.231956", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.191287", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [server3]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.035415", "end": "2021-11-11 20:08:14.239019", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.203604", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [etcd3]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.032685", "end": "2021-11-11 20:08:14.236221", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.203536", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [etcd2]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.038535", "end": "2021-11-11 20:08:14.262965", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.224430", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [server2]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.038260", "end": "2021-11-11 20:08:14.286815", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.248555", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [snap1]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.041670", "end": "2021-11-11 20:08:14.580239", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.538569", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [snap3]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.035681", "end": "2021-11-11 20:08:14.626929", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.591248", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [mds1]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.041791", "end": "2021-11-11 20:08:14.627745", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.585954", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [snap2]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.044270", "end": "2021-11-11 20:08:14.615993", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.571723", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [mds2]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.047527", "end": "2021-11-11 20:08:14.658510", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.610983", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [mds3]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.038690", "end": "2021-11-11 20:08:14.944898", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.906208", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [localhost]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.037397", "end": "2021-11-11 20:08:14.962699", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.925302", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [server1]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.038511", "end": "2021-11-11 20:08:15.027817", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.989306", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [nginx1]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.036311", "end": "2021-11-11 20:08:15.034947", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.998636", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring fatal: [nginx2]: FAILED! => {"changed": true, "cmd": "dpkg -s podlators-perl", "delta": "0:00:00.035823", "end": "2021-11-11 20:08:15.032724", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:08:14.996901", "stderr": "dpkg-query: package 'podlators-perl' is not installed and no information is available\nUse dpkg --info (= dpkg-deb --info) to examine archive files,\nand dpkg --contents (= dpkg-deb --contents) to list their contents.", "stderr_lines": ["dpkg-query: package 'podlators-perl' is not installed and no information is available", "Use dpkg --info (= dpkg-deb --info) to examine archive files,", "and dpkg --contents (= dpkg-deb --contents) to list their contents."], "stdout": "", "stdout_lines": []} ...ignoring

TASK [prepare_software_env : install lib with apt] ***** [WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo

fatal: [server2]: FAILED! => {"changed": true, "cmd": "sudo apt-get -y install podlators-perl", "delta": "0:00:00.286608", "end": "2021-11-11 20:08:15.746122", "msg": "non-zero return code", "rc": 100, "start": "2021-11-11 20:08:15.459514", "stderr": "E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable)\nE: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it?", "stderr_lines": ["E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable)", "E: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it?"], "stdout": "", "stdout_lines": []} changed: [etcd3] changed: [etcd2] changed: [etcd1] fatal: [mds1]: FAILED! => {"changed": true, "cmd": "sudo apt-get -y install podlators-perl", "delta": "0:00:00.083557", "end": "2021-11-11 20:08:16.313183", "msg": "non-zero return code", "rc": 100, "start": "2021-11-11 20:08:16.229626", "stderr": "E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable)\nE: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it?", "stderr_lines": ["E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable)", "E: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it?"], "stdout": "", "stdout_lines": []} changed: [snap2] changed: [snap1] changed: [mds2] changed: [mds3] changed: [localhost] fatal: [nginx1]: FAILED! => {"changed": true, "cmd": "sudo apt-get -y install podlators-perl", "delta": "0:00:00.078826", "end": "2021-11-11 20:08:17.809896", "msg": "non-zero return code", "rc": 100, "start": "2021-11-11 20:08:17.731070", "stderr": "E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable)\nE: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it?", "stderr_lines": ["E: Could not get lock /var/lib/dpkg/lock - open (11: Resource temporarily unavailable)", "E: Unable to lock the administration directory (/var/lib/dpkg/), is another process using it?"], "stdout": "", "stdout_lines": []} changed: [server1] changed: [nginx2] changed: [server3] changed: [snap3]

NO MORE HOSTS LEFT ***** to retry, use: --limit @/home/curve/curve/curve-ansible/deploy_curve.retry

PLAY RECAP ***** etcd1 : ok=30 changed=8 unreachable=0 failed=0 etcd2 : ok=30 changed=8 unreachable=0 failed=0 etcd3 : ok=30 changed=8 unreachable=0 failed=0 localhost : ok=31 changed=8 unreachable=0 failed=0 mds1 : ok=29 changed=7 unreachable=0 failed=1 mds2 : ok=30 changed=8 unreachable=0 failed=0 mds3 : ok=30 changed=8 unreachable=0 failed=0 nginx1 : ok=29 changed=7 unreachable=0 failed=1 nginx2 : ok=30 changed=8 unreachable=0 failed=0 server1 : ok=32 changed=8 unreachable=0 failed=0 server2 : ok=31 changed=7 unreachable=0 failed=1 server3 : ok=32 changed=8 unreachable=0 failed=0 snap1 : ok=30 changed=8 unreachable=0 failed=0 snap2 : ok=30 changed=8 unreachable=0 failed=0 snap3 : ok=30 changed=8 unreachable=0 failed=0

我做过很多尝试，但都无法解决这个问题

If you are using a debian system, you need to add all the files in roles/prepare_software_env/tasks/main.ym like podlators-perl changed to perl-modules

Cyber-SiKu commented 3 years ago

Debian modified the name of the package podlators-perl. If the above steps are not correct, you can search for the corresponding package name in the system you are using.

wavemomo commented 3 years ago

Debian modified the name of the package podlators-perl. If the above steps are not correct, you can search for the corresponding package name in the system you are using.

Thank you, I had solved the above problem, but another error occurs:

TASK [install_package : pip install requests] ** fatal: [mds3]: FAILED! => {"changed": true, "cmd": "sudo pip install requests", "delta": "0:00:00.017825", "end": "2021-11-11 20:34:34.611642", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:34:34.593817", "stderr": "sudo: pip: command not found", "stderr_lines": ["sudo: pip: command not found"], "stdout": "", "stdout_lines": []} ...ignoring changed: [mds1] changed: [mds2]

TASK [install_package : pip2 install requests] ***** skipping: [mds1] skipping: [mds2] fatal: [mds3]: FAILED! => {"changed": true, "cmd": "sudo pip2 install requests", "delta": "0:00:00.020144", "end": "2021-11-11 20:34:35.582221", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:34:35.562077", "stderr": "sudo: pip2: command not found", "stderr_lines": ["sudo: pip2: command not found"], "stdout": "", "stdout_lines": []}

NO MORE HOSTS LEFT ***** to retry, use: --limit @/home/curve/curve/curve-ansible/deploy_curve.retry

PLAY RECAP ***** etcd1 : ok=63 changed=14 unreachable=0 failed=0
etcd2 : ok=63 changed=14 unreachable=0 failed=0
etcd3 : ok=63 changed=14 unreachable=0 failed=0
localhost : ok=40 changed=9 unreachable=0 failed=0
mds1 : ok=88 changed=18 unreachable=0 failed=0
mds2 : ok=88 changed=18 unreachable=0 failed=0
mds3 : ok=88 changed=18 unreachable=0 failed=1
nginx1 : ok=39 changed=9 unreachable=0 failed=0
nginx2 : ok=39 changed=9 unreachable=0 failed=0
server1 : ok=41 changed=9 unreachable=0 failed=0
server2 : ok=41 changed=9 unreachable=0 failed=0
server3 : ok=41 changed=9 unreachable=0 failed=0
snap1 : ok=39 changed=9 unreachable=0 failed=0
snap2 : ok=39 changed=9 unreachable=0 failed=0
snap3 : ok=39 changed=9 unreachable=0 failed=0

I try to use the absolute path and use the “export PATH=$PATH:/usr/bin/:/usr/local/bin/;” to solve it , but it doesn't work. Thank you very much.

Cyber-SiKu commented 3 years ago

Debian modified the name of the package podlators-perl. If the above steps are not correct, you can search for the corresponding package name in the system you are using.

Thank you, I had solved the above problem, but another error occurs:

TASK [install_package : pip install requests] ** fatal: [mds3]: FAILED! => {"changed": true, "cmd": "sudo pip install requests", "delta": "0:00:00.017825", "end": "2021-11-11 20:34:34.611642", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:34:34.593817", "stderr": "sudo: pip: command not found", "stderr_lines": ["sudo: pip: command not found"], "stdout": "", "stdout_lines": []} ...ignoring changed: [mds1] changed: [mds2]

TASK [install_package : pip2 install requests] ***** skipping: [mds1] skipping: [mds2] fatal: [mds3]: FAILED! => {"changed": true, "cmd": "sudo pip2 install requests", "delta": "0:00:00.020144", "end": "2021-11-11 20:34:35.582221", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:34:35.562077", "stderr": "sudo: pip2: command not found", "stderr_lines": ["sudo: pip2: command not found"], "stdout": "", "stdout_lines": []}

NO MORE HOSTS LEFT ***** to retry, use: --limit @/home/curve/curve/curve-ansible/deploy_curve.retry

PLAY RECAP ***** etcd1 : ok=63 changed=14 unreachable=0 failed=0 etcd2 : ok=63 changed=14 unreachable=0 failed=0 etcd3 : ok=63 changed=14 unreachable=0 failed=0 localhost : ok=40 changed=9 unreachable=0 failed=0 mds1 : ok=88 changed=18 unreachable=0 failed=0 mds2 : ok=88 changed=18 unreachable=0 failed=0 mds3 : ok=88 changed=18 unreachable=0 failed=1 nginx1 : ok=39 changed=9 unreachable=0 failed=0 nginx2 : ok=39 changed=9 unreachable=0 failed=0 server1 : ok=41 changed=9 unreachable=0 failed=0 server2 : ok=41 changed=9 unreachable=0 failed=0 server3 : ok=41 changed=9 unreachable=0 failed=0 snap1 : ok=39 changed=9 unreachable=0 failed=0 snap2 : ok=39 changed=9 unreachable=0 failed=0 snap3 : ok=39 changed=9 unreachable=0 failed=0

I try to use the absolute path and use the “export PATH=$PATH:/usr/bin/:/usr/local/bin/;” to solve it , but it doesn't work. Thank you very much.

you should install pip like: sudo apt install python-pip

wavemomo commented 3 years ago

Debian modified the name of the package podlators-perl. If the above steps are not correct, you can search for the corresponding package name in the system you are using.

Thank you, I had solved the above problem, but another error occurs: TASK [install_package : pip install requests] ** fatal: [mds3]: FAILED! => {"changed": true, "cmd": "sudo pip install requests", "delta": "0:00:00.017825", "end": "2021-11-11 20:34:34.611642", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:34:34.593817", "stderr": "sudo: pip: command not found", "stderr_lines": ["sudo: pip: command not found"], "stdout": "", "stdout_lines": []} ...ignoring changed: [mds1] changed: [mds2] TASK [install_package : pip2 install requests] * skipping: [mds1] skipping: [mds2] fatal: [mds3]: FAILED! => {"changed": true, "cmd": "sudo pip2 install requests", "delta": "0:00:00.020144", "end": "2021-11-11 20:34:35.582221", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:34:35.562077", "stderr": "sudo: pip2: command not found", "stderr_lines": ["sudo: pip2: command not found"], "stdout": "", "stdout_lines": []} NO MORE HOSTS LEFT ***** to retry, use: --limit @/home/curve/curve/curve-ansible/deploy_curve.retry PLAY RECAP ***** etcd1 : ok=63 changed=14 unreachable=0 failed=0 etcd2 : ok=63 changed=14 unreachable=0 failed=0 etcd3 : ok=63 changed=14 unreachable=0 failed=0 localhost : ok=40 changed=9 unreachable=0 failed=0 mds1 : ok=88 changed=18 unreachable=0 failed=0 mds2 : ok=88 changed=18 unreachable=0 failed=0 mds3 : ok=88 changed=18 unreachable=0 failed=1 nginx1 : ok=39 changed=9 unreachable=0 failed=0 nginx2 : ok=39 changed=9 unreachable=0 failed=0 server1 : ok=41 changed=9 unreachable=0 failed=0 server2 : ok=41 changed=9 unreachable=0 failed=0 server3 : ok=41 changed=9 unreachable=0 failed=0 snap1 : ok=39 changed=9 unreachable=0 failed=0 snap2 : ok=39 changed=9 unreachable=0 failed=0 snap3 : ok=39 changed=9 unreachable=0 failed=0 I try to use the absolute path and use the “export PATH=$PATH:/usr/bin/:/usr/local/bin/;” to solve it , but it doesn't work. Thank you very much.

you should install pip like: sudo apt install python-pip

I had install pip wtih "sudo apt install python-pip" before the occured error, but it doesn't work. And I also try to remove pip and install it again, it doesn't work.

Cyber-SiKu commented 3 years ago

Debian modified the name of the package podlators-perl. If the above steps are not correct, you can search for the corresponding package name in the system you are using.

Thank you, I had solved the above problem, but another error occurs: TASK [install_package : pip install requests] ** fatal: [mds3]: FAILED! => {"changed": true, "cmd": "sudo pip install requests", "delta": "0:00:00.017825", "end": "2021-11-11 20:34:34.611642", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:34:34.593817", "stderr": "sudo: pip: command not found", "stderr_lines": ["sudo: pip: command not found"], "stdout": "", "stdout_lines": []} ...ignoring changed: [mds1] changed: [mds2] TASK [install_package : pip2 install requests] * skipping: [mds1] skipping: [mds2] fatal: [mds3]: FAILED! => {"changed": true, "cmd": "sudo pip2 install requests", "delta": "0:00:00.020144", "end": "2021-11-11 20:34:35.582221", "msg": "non-zero return code", "rc": 1, "start": "2021-11-11 20:34:35.562077", "stderr": "sudo: pip2: command not found", "stderr_lines": ["sudo: pip2: command not found"], "stdout": "", "stdout_lines": []} NO MORE HOSTS LEFT ***** to retry, use: --limit @/home/curve/curve/curve-ansible/deploy_curve.retry PLAY RECAP ***** etcd1 : ok=63 changed=14 unreachable=0 failed=0 etcd2 : ok=63 changed=14 unreachable=0 failed=0 etcd3 : ok=63 changed=14 unreachable=0 failed=0 localhost : ok=40 changed=9 unreachable=0 failed=0 mds1 : ok=88 changed=18 unreachable=0 failed=0 mds2 : ok=88 changed=18 unreachable=0 failed=0 mds3 : ok=88 changed=18 unreachable=0 failed=1 nginx1 : ok=39 changed=9 unreachable=0 failed=0 nginx2 : ok=39 changed=9 unreachable=0 failed=0 server1 : ok=41 changed=9 unreachable=0 failed=0 server2 : ok=41 changed=9 unreachable=0 failed=0 server3 : ok=41 changed=9 unreachable=0 failed=0 snap1 : ok=39 changed=9 unreachable=0 failed=0 snap2 : ok=39 changed=9 unreachable=0 failed=0 snap3 : ok=39 changed=9 unreachable=0 failed=0 I try to use the absolute path and use the “export PATH=$PATH:/usr/bin/:/usr/local/bin/;” to solve it , but it doesn't work. Thank you very much.

you should install pip like: sudo apt install python-pip

I had install pip wtih "sudo apt install python-pip" before the occured error, but it doesn't work. And I also try to remove pip and install it again, it doesn't work.

it seems like that mds1 mds2 has install but mds3 not install,you can run cmdpip install requests in mds3. What does the error output look like

wavemomo commented 3 years ago

yes, I pip install requests in mds3 and it works. But another error occurs:

TASK [create physical pool] **** fatal: [mds1]: FAILED! => {"changed": true, "cmd": "curve-tool -op=create_physicalpool -cluster_map=/etc/curve/topo.json", "delta": "0:00:00.018864", "end": "2021-11-11 20:54:13.668432", "msg": "non-zero return code", "rc": 247, "start": "2021-11-11 20:54:13.649568", "stderr": "E 2021-11-11T20:54:13.666478+0800 15531 curvefsTool.cpp:482] ListPoolZone Rpc response fail. Message is :statusCode: -9\n , physicalpoolid = 0\nE 2021-11-11T20:54:13.666504+0800 15531 curvefsTool.cpp:132] scan cluster fail.\nE 2021-11-11T20:54:13.666514+0800 15531 curvefsTool.cpp:1109] exec fail, ret = -9", "stderr_lines": ["E 2021-11-11T20:54:13.666478+0800 15531 curvefsTool.cpp:482] ListPoolZone Rpc response fail. Message is :statusCode: -9", " , physicalpoolid = 0", "E 2021-11-11T20:54:13.666504+0800 15531 curvefsTool.cpp:132] scan cluster fail.", "E 2021-11-11T20:54:13.666514+0800 15531 curvefsTool.cpp:1109] exec fail, ret = -9"], "stdout": "", "stdout_lines": []}

NO MORE HOSTS LEFT ***** to retry, use: --limit @/home/curve/curve/curve-ansible/deploy_curve.retry

PLAY RECAP ***** etcd1 : ok=63 changed=14 unreachable=0 failed=0
etcd2 : ok=63 changed=14 unreachable=0 failed=0
etcd3 : ok=63 changed=14 unreachable=0 failed=0
localhost : ok=40 changed=9 unreachable=0 failed=0
mds1 : ok=137 changed=39 unreachable=0 failed=1
mds2 : ok=139 changed=39 unreachable=0 failed=0
mds3 : ok=139 changed=39 unreachable=0 failed=0
nginx1 : ok=39 changed=9 unreachable=0 failed=0
nginx2 : ok=39 changed=9 unreachable=0 failed=0
server1 : ok=41 changed=9 unreachable=0 failed=0
server2 : ok=41 changed=9 unreachable=0 failed=0
server3 : ok=41 changed=9 unreachable=0 failed=0
snap1 : ok=39 changed=9 unreachable=0 failed=0
snap2 : ok=39 changed=9 unreachable=0 failed=0
snap3 : ok=39 changed=9 unreachable=0 failed=0

It seems difficult to deploy smoothly.

Cyber-SiKu commented 3 years ago

can you show file /etc/curve/topo.json?

wavemomo commented 3 years ago

can you show file /etc/curve/topo.json?

/etc/curve/topo.json:

{ "logicalpools": [ { "copysetnum": 300, "name": "logicalPool1", "physicalpool": "pool1", "replicasnum": 3, "scatterwidth": 0, "type": 0, "zonenum": 3 } ], "servers": [ { "externalip": "10.80.46.244", "externalport": 0, "internalip": "10.80.46.244", "internalport": 0, "name": "server1", "physicalpool": "pool1", "zone": "zone1" }, { "externalip": "10.80.46.247", "externalport": 0, "internalip": "10.80.46.247", "internalport": 0, "name": "server2", "physicalpool": "pool1", "zone": "zone2" }, { "externalip": "10.80.46.251", "externalport": 0, "internalip": "10.80.46.251", "internalport": 0, "name": "server3", "physicalpool": "pool1", "zone": "zone3" } ] }

wavemomo commented 3 years ago

can you show file /etc/curve/topo.json?

And I also want to know how to edit "group_vars/chunkservers.yml", how to get the disk name. Can I use "df -h" to get the name curve wants.

Cyber-SiKu commented 3 years ago

run cmd: curve_ops_tool status

SeanHai commented 3 years ago

can you show file /etc/curve/topo.json?

And I also want to know how to edit "group_vars/chunkservers.yml", how to get the disk name. Can I use "df -h" to get the name curve wants.

If the 'auto_get_disk_list=True' used in server.ini, It will run this command to get available disk on your machain get_disk_list_cmd="lsscsi |grep ATA|awk '{print $7}'|awk -F/ '{print $3}'"

if the 'auto_get_disk_list=False' will use disk set in 'group_vars/chunkservers.yml'

And you can use command 'lsblk' to get the disk list.

SeanHai commented 3 years ago

can you show file /etc/curve/topo.json?

And I also want to know how to edit "group_vars/chunkservers.yml", how to get the disk name. Can I use "df -h" to get the name curve wants.

And you can add wechat number 'opencurve' to join our user group, we can help you timely.

wavemomo commented 2 years ago

run cmd: curve_ops_tool status

it shows:

curve@debian1:~/curve/curve-ansible$ curve_ops_tool status Cluster status: ListPoolZone fail with errCode: -9 ListZoneInPhysicalPool fail, physicalPoolId: 0 ListServersInCluster fail! Copysets are not healthy! More than one etcd is active Get status metric from 10.80.46.244:8081 fail Get status metric from 10.80.46.247:8081 fail Get status metric from 10.80.46.251:8081 fail No snapshot-clone-server is active snapshot-clone-server 10.80.46.244:5556 is offline snapshot-clone-server 10.80.46.247:5556 is offline snapshot-clone-server 10.80.46.251:5556 is offline cluster is not healthy total copysets: 0, unhealthy copysets: 0, unhealthy_ratio: 0% ListLogicalPool fail with errCode: -9 ListLogicalPoolsInPhysicalPool fail! GetPoolsInCluster fail! physical pool number: 1, logical pool number: 0 ListLogicalPool fail with errCode: -9 ListLogicalPoolsInPhysicalPool 0 fail ListLogicalPoolsInCluster fail! GetSpaceInfo fail!

Client status:

MDS status: version: 1.2.1-rc0+035c4345 current MDS: 10.80.46.244:6666 online mds list: 10.80.46.244:6666, 10.80.46.247:6666, 10.80.46.251:6666 offline mds list:

Etcd status: version: 3.4.0 current etcd: 10.80.46.244:2379, 10.80.46.251:2379 online etcd list: 10.80.46.244:2379, 10.80.46.247:2379, 10.80.46.251:2379 offline etcd list:

SnapshotCloneServer status: no version found! GetAndCheckSnapshotCloneVersion fail Get status metric from 10.80.46.244:8081 fail Get status metric from 10.80.46.247:8081 fail Get status metric from 10.80.46.251:8081 fail current snapshot-clone-server: online snapshot-clone-server list: offline snapshot-clone-server list: 10.80.46.244:5556, 10.80.46.247:5556, 10.80.46.251:5556

ChunkServer status: ListPoolZone fail with errCode: -9 ListZoneInPhysicalPool fail, physicalPoolId: 0 ListServersInCluster fail! ListChunkServersInCluster fail! GetAndCheckChunkserverVersion fail ListPoolZone fail with errCode: -9 ListZoneInPhysicalPool fail, physicalPoolId: 0 ListServersInCluster fail! ListChunkServersInCluster fail!

SeanHai commented 2 years ago

run cmd: curve_ops_tool status

it shows:

curve@debian1:~/curve/curve-ansible$ curve_ops_tool status Cluster status: ListPoolZone fail with errCode: -9 ListZoneInPhysicalPool fail, physicalPoolId: 0 ListServersInCluster fail! Copysets are not healthy! More than one etcd is active Get status metric from 10.80.46.244:8081 fail Get status metric from 10.80.46.247:8081 fail Get status metric from 10.80.46.251:8081 fail No snapshot-clone-server is active snapshot-clone-server 10.80.46.244:5556 is offline snapshot-clone-server 10.80.46.247:5556 is offline snapshot-clone-server 10.80.46.251:5556 is offline cluster is not healthy total copysets: 0, unhealthy copysets: 0, unhealthy_ratio: 0% ListLogicalPool fail with errCode: -9 ListLogicalPoolsInPhysicalPool fail! GetPoolsInCluster fail! physical pool number: 1, logical pool number: 0 ListLogicalPool fail with errCode: -9 ListLogicalPoolsInPhysicalPool 0 fail ListLogicalPoolsInCluster fail! GetSpaceInfo fail!

Client status:

MDS status: version: 1.2.1-rc0+035c4345 current MDS: 10.80.46.244:6666 online mds list: 10.80.46.244:6666, 10.80.46.247:6666, 10.80.46.251:6666 offline mds list:

Etcd status: version: 3.4.0 current etcd: 10.80.46.244:2379, 10.80.46.251:2379 online etcd list: 10.80.46.244:2379, 10.80.46.247:2379, 10.80.46.251:2379 offline etcd list:

SnapshotCloneServer status: no version found! GetAndCheckSnapshotCloneVersion fail Get status metric from 10.80.46.244:8081 fail Get status metric from 10.80.46.247:8081 fail Get status metric from 10.80.46.251:8081 fail current snapshot-clone-server: online snapshot-clone-server list: offline snapshot-clone-server list: 10.80.46.244:5556, 10.80.46.247:5556, 10.80.46.251:5556

ChunkServer status: ListPoolZone fail with errCode: -9 ListZoneInPhysicalPool fail, physicalPoolId: 0 ListServersInCluster fail! ListChunkServersInCluster fail! GetAndCheckChunkserverVersion fail ListPoolZone fail with errCode: -9 ListZoneInPhysicalPool fail, physicalPoolId: 0 ListServersInCluster fail! ListChunkServersInCluster fail!

It seems dirty data in cluster, you can clean the cluster thoroughly and try again. Run command 'ansible-playbook clean_curve.yml -i server.ini' and ensure run successfully.

wavemomo commented 2 years ago

run cmd: curve_ops_tool status

it shows: curve@debian1:~/curve/curve-ansible$ curve_ops_tool status Cluster status: ListPoolZone fail with errCode: -9 ListZoneInPhysicalPool fail, physicalPoolId: 0 ListServersInCluster fail! Copysets are not healthy! More than one etcd is active Get status metric from 10.80.46.244:8081 fail Get status metric from 10.80.46.247:8081 fail Get status metric from 10.80.46.251:8081 fail No snapshot-clone-server is active snapshot-clone-server 10.80.46.244:5556 is offline snapshot-clone-server 10.80.46.247:5556 is offline snapshot-clone-server 10.80.46.251:5556 is offline cluster is not healthy total copysets: 0, unhealthy copysets: 0, unhealthy_ratio: 0% ListLogicalPool fail with errCode: -9 ListLogicalPoolsInPhysicalPool fail! GetPoolsInCluster fail! physical pool number: 1, logical pool number: 0 ListLogicalPool fail with errCode: -9 ListLogicalPoolsInPhysicalPool 0 fail ListLogicalPoolsInCluster fail! GetSpaceInfo fail! Client status: MDS status: version: 1.2.1-rc0+035c4345 current MDS: 10.80.46.244:6666 online mds list: 10.80.46.244:6666, 10.80.46.247:6666, 10.80.46.251:6666 offline mds list: Etcd status: version: 3.4.0 current etcd: 10.80.46.244:2379, 10.80.46.251:2379 online etcd list: 10.80.46.244:2379, 10.80.46.247:2379, 10.80.46.251:2379 offline etcd list: SnapshotCloneServer status: no version found! GetAndCheckSnapshotCloneVersion fail Get status metric from 10.80.46.244:8081 fail Get status metric from 10.80.46.247:8081 fail Get status metric from 10.80.46.251:8081 fail current snapshot-clone-server: online snapshot-clone-server list: offline snapshot-clone-server list: 10.80.46.244:5556, 10.80.46.247:5556, 10.80.46.251:5556 ChunkServer status: ListPoolZone fail with errCode: -9 ListZoneInPhysicalPool fail, physicalPoolId: 0 ListServersInCluster fail! ListChunkServersInCluster fail! GetAndCheckChunkserverVersion fail ListPoolZone fail with errCode: -9 ListZoneInPhysicalPool fail, physicalPoolId: 0 ListServersInCluster fail! ListChunkServersInCluster fail!

It seems dirty data in cluster, you can clean the cluster thoroughly and try again. Run command 'ansible-playbook clean_curve.yml -i server.ini' and ensure run successfully.

Thanks so mush， I had solve my problem.