imixs / imixs-cloud

A Lightweight Kubernetes Environment
https://imixs.github.io/imixs-cloud/
GNU General Public License v3.0
200 stars 83 forks source link

Ceph : Error EINVAL: Failed to connect to ceph01 (ceph01) #53

Closed guidtz closed 2 years ago

guidtz commented 3 years ago

Hello,

do you have any problem to connect node to ceph master ? When I tried to add a node :

$ sudo ceph orch host add ceph01
Error EINVAL: Failed to connect to ceph01 (ceph01).
Check that the host is reachable and accepts connections using the cephadm SSH key

you may want to run:
> ceph cephadm get-ssh-config > ssh_config
> ceph config-key get mgr/cephadm/ssh_identity_key > key
> ssh -F ssh_config -i key root@ceph01

So I configured ssh access to node ceph01 with .ssh/config and It's works manually :

$ sudo ssh ceph01
Warning: Permanently added 'ceph01,192.168.85.31' (ECDSA) to the list of known hosts.
Linux ceph01 4.19.0-12-amd64 #1 SMP Debian 4.19.152-1 (2020-10-18) x86_64

The programs included with the Debian GNU/Linux system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.

Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
permitted by applicable law.
Last login: Sat Nov 21 18:48:29 2020 from 192.168.85.30
root@ceph01:~#

Do you have an idea ?

rsoika commented 3 years ago

Yes it could be, that your node is not accepting the public key from the root node. Take a look at this tutorial. Here I explained the procedure in more detail in the section "Expending the Cluster".

Let me know if you can solve your issue so that we can improve the documentation.

vitalyUstalu commented 3 years ago

Hello, I had the same problem with a manualy installed ceph cluster (via cephadm) and fixed it by installing python3 on target host. I found it here https://github.com/ceph/ceph/blob/master/src/pybind/mgr/cephadm/module.py#L1008 Unfortunately this message is not displayed further.

guidtz commented 3 years ago

Ok I'll go to test this soon.

stale[bot] commented 3 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

thatsk commented 2 years ago

this is worst case where it is not helping for beginneer even our dns is working fine we added in host file and still we get this error and not able to get started .

thatsk commented 2 years ago

single node cluster is not working also for quincy release hope fully better docs make better product

rsoika commented 2 years ago

@thatsk Which exact problem do you have? Do you have problems to install your ceph cluster? I have written a new tutorial how to install Ceph on Debian: https://ralph.blog.imixs.com/2021/10/03/ceph-pacific-running-on-debian-11-bullseye/

As I recommand you should run ceph independent from your Kubernetes cluster. So if it is a ceph problem you need to search first for help in the ceph community.

If your ceph cluster is up and running, but your imixs-cloud setup does not be able to create a static persistence volume connected to your Ceph than we can discuss it here.