search

ceph / ceph-container

Docker files and images to run Ceph in containers
Apache License 2.0
1.32k stars 522 forks source link

Enabling RGW in ceph Orch #2036

Closed remo233 closed 5 months ago

remo233 commented 2 years ago

Hi all,

Recently, I deployed ceph orch ( pacific ) in my nodes with 5 mons 5 mgrs 238 osds and 5 rgw.

Yesterday , 4 osds went out and 2 rgws down. So, i restart whole rgw by "ceph orch restart rgw.rgw". After two minutes , the whole rgw nodes goes down.

Then I turned up the 4 osds and also waited to become the ceph Health OK. But, rgw services is up and running and the port is binding.

RGW logs :

root@cephr04:/var/log/ceph/0df2c8fe-fdf1-11ec-9713-b175dcec685a# tail -800 ceph-client.rgw.rgw.cephr04.wpfaui.log 2022-07-25T06:06:37.528+0000 7f89423035c0 0 deferred set uid:gid to 167:167 (ceph:ceph) 2022-07-25T06:06:37.528+0000 7f89423035c0 0 ceph version 16.2.9 (4c3647a322c0ff5a1dd2344e039859dcbd28c830) pacific (stable), process radosgw, pid 6 2022-07-25T06:06:37.528+0000 7f89423035c0 0 framework: beast 2022-07-25T06:06:37.528+0000 7f89423035c0 0 framework conf key: port, val: 80 2022-07-25T06:06:37.528+0000 7f89423035c0 1 radosgw_Main not setting numa affinity 2022-07-25T06:11:37.529+0000 7f892d9be700 -1 Initialization timeout, failed to initialize 2022-07-25T06:11:47.841+0000 7fae36b985c0 0 deferred set uid:gid to 167:167 (ceph:ceph) 2022-07-25T06:11:47.841+0000 7fae36b985c0 0 ceph version 16.2.9 (4c3647a322c0ff5a1dd2344e039859dcbd28c830) pacific (stable), process radosgw, pid 7 2022-07-25T06:11:47.841+0000 7fae36b985c0 0 framework: beast 2022-07-25T06:11:47.841+0000 7fae36b985c0 0 framework conf key: port, val: 80 2022-07-25T06:11:47.841+0000 7fae36b985c0 1 radosgw_Main not setting numa affinity 2022-07-25T06:16:47.842+0000 7fae22253700 -1 Initialization timeout, failed to initialize 2022-07-25T06:16:58.114+0000 7fb4bac385c0 0 deferred set uid:gid to 167:167 (ceph:ceph) 2022-07-25T06:16:58.114+0000 7fb4bac385c0 0 ceph version 16.2.9 (4c3647a322c0ff5a1dd2344e039859dcbd28c830) pacific (stable), process radosgw, pid 7 2022-07-25T06:16:58.114+0000 7fb4bac385c0 0 framework: beast 2022-07-25T06:16:58.114+0000 7fb4bac385c0 0 framework conf key: port, val: 80 2022-07-25T06:16:58.114+0000 7fb4bac385c0 1 radosgw_Main not setting numa affinity 2022-07-25T06:21:58.111+0000 7fb4a62f3700 -1 Initialization timeout, failed to initialize 2022-07-25T06:22:08.359+0000 7f4b33dbd5c0 0 deferred set uid:gid to 167:167 (ceph:ceph) 2022-07-25T06:22:08.359+0000 7f4b33dbd5c0 0 ceph version 16.2.9 (4c3647a322c0ff5a1dd2344e039859dcbd28c830) pacific (stable), process radosgw, pid 7 2022-07-25T06:22:08.359+0000 7f4b33dbd5c0 0 framework: beast 2022-07-25T06:22:08.359+0000 7f4b33dbd5c0 0 framework conf key: port, val: 80 2022-07-25T06:22:08.359+0000 7f4b33dbd5c0 1 radosgw_Main not setting numa affinity 2022-07-25T06:25:03.189+0000 7fa6920085c0 0 deferred set uid:gid to 167:167 (ceph:ceph) 2022-07-25T06:25:03.189+0000 7fa6920085c0 0 ceph version 16.2.9 (4c3647a322c0ff5a1dd2344e039859dcbd28c830) pacific (stable), process radosgw, pid 7 2022-07-25T06:25:03.189+0000 7fa6920085c0 0 framework: beast 2022-07-25T06:25:03.189+0000 7fa6920085c0 0 framework conf key: port, val: 80 2022-07-25T06:25:03.189+0000 7fa6920085c0 1 radosgw_Main not setting numa affinity

Environment:

github-actions[bot] commented 6 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in a week if no further activity occurs. Thank you for your contributions.

github-actions[bot] commented 5 months ago

This issue has been automatically closed due to inactivity. Please re-open if this still requires investigation.