brandond
commented
1 year ago You appear to have some sort of security module (probably selinux) enabled that is preventing pods from running correctly; did you install RKE2 using RPMs, install the rke2-selinux package, and enable selinux support?
Environmental Info: RKE2 Version: rke2 version v1.27.1+rke2r1 (9ce3825ec005872a0873307844ba99a2bdd4ee19) go version go1.20.3 X:boringcrypto
Node(s) CPU architecture, OS, and Version:
OS: "Red Hat Enterprise Linux 9.1 (Plow)"
[root@si0vm09262 bin]# ./kubectl get pods -A NAMESPACE NAME READY STATUS RESTARTS AGE kube-system etcd-si0vm09262 1/1 Running 0 18s kube-system helm-install-rke2-canal-rjrf5 0/1 Error 1 (9s ago) 11s kube-system helm-install-rke2-coredns-j7hw2 0/1 CrashLoopBackOff 1 (8s ago) 11s kube-system helm-install-rke2-ingress-nginx-pcgzh 0/1 Pending 0 11s kube-system helm-install-rke2-metrics-server-v64z7 0/1 Pending 0 11s kube-system helm-install-rke2-snapshot-controller-crd-tj9sz 0/1 Pending 0 11s kube-system helm-install-rke2-snapshot-controller-rpj8v 0/1 Pending 0 11s kube-system helm-install-rke2-snapshot-validation-webhook-rngds 0/1 Pending 0 11s kube-system kube-apiserver-si0vm09262 1/1 Running 0 16s kube-system kube-controller-manager-si0vm09262 1/1 Running 0 16s kube-system kube-proxy-si0vm09262 1/1 Running 0 12s kube-system kube-scheduler-si0vm09262 1/1 Running 0 16s
[root@si0vm09262 bin]# ./kubectl -n kube-system logs helm-install-rke2-canal-rjrf5 Error loading shared library libreadline.so.8: Permission denied (needed by /usr/bin/entry) Error relocating /usr/bin/entry: unstifle_history: symbol not found Error relocating /usr/bin/entry: rl_make_bare_keymap: symbol not found Error relocating /usr/bin/entry: rl_bind_key_if_unbound_in_map: symbol not found Error relocating /usr/bin/entry: rl_macro_dumper: symbol not found Error relocating /usr/bin/entry: previous_history: symbol not found Error relocating /usr/bin/entry: rl_vi_end_word: symbol not found Error relocating /usr/bin/entry: rl_parse_and_bind: symbol not found Error relocating /usr/bin/entry: rl_redisplay: symbol not found Error relocating /usr/bin/entry: rl_push_macro_input: symbol not found Error relocating /usr/bin/entry: rl_bind_key_in_map: symbol not found Error relocating /usr/bin/entry: clear_history: symbol not found Error relocating /usr/bin/entry: add_history: symbol not found Error relocating /usr/bin/entry: rl_redraw_prompt_last_line: symbol not found Error relocating /usr/bin/entry: rl_function_of_keyseq_len: symbol not found Error relocating /usr/bin/entry: history_get: symbol not found Error relocating /usr/bin/entry: rl_get_keymap: symbol not found Error relocating /usr/bin/entry: rl_kill_text: symbol not found Error relocating /usr/bin/entry: remove_history: symbol not found Error relocating /usr/bin/entry: history_truncate_file: symbol not found Error relocating /usr/bin/entry: rl_generic_bind: symbol not found Error relocating /usr/bin/entry: rl_read_key: symbol not found Error relocating /usr/bin/entry: read_history: symbol not found Error relocating /usr/bin/entry: rl_add_defun: symbol not found Error relocating /usr/bin/entry: history_expand: symbol not found Error relocating /usr/bin/entry: rl_translate_keyseq: symbol not found Error relocating /usr/bin/entry: rl_forced_update_display: symbol not found Error relocating /usr/bin/entry: rl_set_timeout: symbol not found Error relocating /usr/bin/entry: rl_read_init_file: symbol not found Error relocating /usr/bin/entry: rl_invoking_keyseqs: symbol not found Error relocating /usr/bin/entry: append_history: symbol not found Error relocating /usr/bin/entry: free_history_entry: symbol not found Error relocating /usr/bin/entry: rl_unbind_key_in_map: symbol not found Error relocating /usr/bin/entry: rl_set_signals: symbol not found Error relocating /usr/bin/entry: readline: symbol not found Error relocating /usr/bin/entry: rl_variable_value: symbol not found Error relocating /usr/bin/entry: history_set_pos: symbol not found Error relocating /usr/bin/entry: rl_unbind_function_in_map: symbol not found Error relocating /usr/bin/entry: read_history_range: symbol not found Error relocating /usr/bin/entry: history_is_stifled: symbol not found Error relocating /usr/bin/entry: stifle_history: symbol not found Error relocating /usr/bin/entry: replace_history_entry: symbol not found Error relocating /usr/bin/entry: rl_insert_text: symbol not found Error relocating /usr/bin/entry: rl_get_keymap_by_name: symbol not found Error relocating /usr/bin/entry: rl_set_screen_size: symbol not found Error relocating /usr/bin/entry: rl_clear_signals: symbol not found Error relocating /usr/bin/entry: rl_vi_bWord: symbol not found Error relocating /usr/bin/entry: rl_get_termcap: symbol not found Error relocating /usr/bin/entry: rl_begin_undo_group: symbol not found Error relocating /usr/bin/entry: rl_ding: symbol not found Error relocating /usr/bin/entry: where_history: symbol not found Error relocating /usr/bin/entry: rl_delete_text: symbol not found Error relocating /usr/bin/entry: rl_function_of_keyseq: symbol not found Error relocating /usr/bin/entry: rl_bind_keyseq: symbol not found Error relocating /usr/bin/entry: rl_reset_terminal: symbol not found Error relocating /usr/bin/entry: history_tokenize: symbol not found Error relocating /usr/bin/entry: rl_forward_word: symbol not found Error relocating /usr/bin/entry: rl_copy_text: symbol not found Error relocating /usr/bin/entry: rl_function_dumper: symbol not found Error relocating /usr/bin/entry: _rl_find_next_mbchar: symbol not found Error relocating /usr/bin/entry: rl_vi_insertion_mode: symbol not found Error relocating /usr/bin/entry: rl_end_undo_group: symbol not found Error relocating /usr/bin/entry: rl_variable_bind: symbol not found Error relocating /usr/bin/entry: rl_named_function: symbol not found Error relocating /usr/bin/entry: rl_initialize: symbol not found Error relocating /usr/bin/entry: rl_vi_start_inserting: symbol not found Error relocating /usr/bin/entry: rl_complete: symbol not found Error relocating /usr/bin/entry: rl_complete_internal: symbol not found Error relocating /usr/bin/entry: history_list: symbol not found Error relocating /usr/bin/entry: tilde_expand: symbol not found Error relocating /usr/bin/entry: rl_funmap_names: symbol not found Error relocating /usr/bin/entry: rl_set_keymap: symbol not found Error relocating /usr/bin/entry: rl_variable_dumper: symbol not found Error relocating /usr/bin/entry: rl_bind_keyseq_in_map: symbol not found Error relocating /usr/bin/entry: write_history: symbol not found Error relocating /usr/bin/entry: rl_on_new_line: symbol not found Error relocating /usr/bin/entry: rl_clear_visible_line: symbol not found Error relocating /usr/bin/entry: rl_completion_matches: symbol not found Error relocating /usr/bin/entry: rl_completion_mode: symbol not found Error relocating /usr/bin/entry: rl_add_undo: symbol not found Error relocating /usr/bin/entry: rl_cleanup_after_signal: symbol not found Error relocating /usr/bin/entry: rl_list_funmap_names: symbol not found Error relocating /usr/bin/entry: using_history: symbol not found Error relocating /usr/bin/entry: history_get_time: symbol not found Error relocating /usr/bin/entry: remove_history_range: symbol not found Error relocating /usr/bin/entry: rl_crlf: symbol not found Error relocating /usr/bin/entry: rl_trim_arg_from_keyseq: symbol not found Error relocating /usr/bin/entry: rl_emacs_editing_mode: symbol not found Error relocating /usr/bin/entry: rl_filename_completion_function: symbol not found Error relocating /usr/bin/entry: rl_tilde_expand: symbol not found Error relocating /usr/bin/entry: rl_newline: symbol not found Error relocating /usr/bin/entry: rl_vi_editing_mode: symbol not found Error relocating /usr/bin/entry: rl_username_completion_function: symbol not found Error relocating /usr/bin/entry: rl_insert: symbol not found Error relocating /usr/bin/entry: rl_tab_insert: symbol not found Error relocating /usr/bin/entry: rl_menu_complete: symbol not found Error relocating /usr/bin/entry: rl_yank_last_arg: symbol not found Error relocating /usr/bin/entry: rl_complete: symbol not found Error relocating /usr/bin/entry: history_length: symbol not found Error relocating /usr/bin/entry: rl_completion_found_quote: symbol not found Error relocating /usr/bin/entry: rl_completion_type: symbol not found Error relocating /usr/bin/entry: rl_point: symbol not found Error relocating /usr/bin/entry: history_lines_written_to_file: symbol not found Error relocating /usr/bin/entry: history_max_entries: symbol not found Error relocating /usr/bin/entry: history_write_timestamps: symbol not found Error relocating /usr/bin/entry: rl_completion_suppress_quote: symbol not found Error relocating /usr/bin/entry: rl_basic_word_break_characters: symbol not found Error relocating /usr/bin/entry: rl_mark: symbol not found Error relocating /usr/bin/entry: rl_directory_rewrite_hook: symbol not found Error relocating /usr/bin/entry: rl_end: symbol not found Error relocating /usr/bin/entry: rl_directory_completion_hook: symbol not found Error relocating /usr/bin/entry: rl_completer_word_break_characters: symbol not found Error relocating /usr/bin/entry: rl_dispatching: symbol not found Error relocating /usr/bin/entry: rl_filename_quoting_desired: symbol not found Error relocating /usr/bin/entry: history_search_delimiter_chars: symbol not found Error relocating /usr/bin/entry: rl_executing_keyseq: symbol not found Error relocating /usr/bin/entry: rl_key_sequence_length: symbol not found Error relocating /usr/bin/entry: rl_filename_dequoting_function: symbol not found Error relocating /usr/bin/entry: rl_filename_rewrite_hook: symbol not found Error relocating /usr/bin/entry: rl_filename_stat_hook: symbol not found Error relocating /usr/bin/entry: vi_insertion_keymap: symbol not found Error relocating /usr/bin/entry: rl_prep_term_function: symbol not found Error relocating /usr/bin/entry: rl_menu_completion_entry_function: symbol not found Error relocating /usr/bin/entry: rl_attempted_completion_function: symbol not found Error relocating /usr/bin/entry: history_comment_char: symbol not found Error relocating /usr/bin/entry: rl_filename_completion_desired: symbol not found Error relocating /usr/bin/entry: rl_done: symbol not found Error relocating /usr/bin/entry: rl_completion_append_character: symbol not found Error relocating /usr/bin/entry: rl_sort_completion_matches: symbol not found Error relocating /usr/bin/entry: history_lines_read_from_file: symbol not found Error relocating /usr/bin/entry: emacs_ctlx_keymap: symbol not found Error relocating /usr/bin/entry: rl_deprep_term_function: symbol not found Error relocating /usr/bin/entry: rl_editing_mode: symbol not found Error relocating /usr/bin/entry: tilde_additional_prefixes: symbol not found Error relocating /usr/bin/entry: history_subst_char: symbol not found Error relocating /usr/bin/entry: rl_readline_state: symbol not found Error relocating /usr/bin/entry: rl_attempted_completion_over: symbol not found Error relocating /usr/bin/entry: vi_movement_keymap: symbol not found Error relocating /usr/bin/entry: rl_filename_quote_characters: symbol not found Error relocating /usr/bin/entry: rl_filename_quoting_function: symbol not found Error relocating /usr/bin/entry: history_quotes_inhibit_expansion: symbol not found Error relocating /usr/bin/entry: rl_readline_name: symbol not found Error relocating /usr/bin/entry: rl_line_buffer: symbol not found Error relocating /usr/bin/entry: emacs_meta_keymap: symbol not found Error relocating /usr/bin/entry: rl_char_is_quoted_p: symbol not found Error relocating /usr/bin/entry: rl_completion_entry_function: symbol not found Error relocating /usr/bin/entry: rl_last_func: symbol not found Error relocating /usr/bin/entry: rl_ignore_some_completions_function: symbol not found Error relocating /usr/bin/entry: rl_completion_invoking_key: symbol not found Error relocating /usr/bin/entry: rl_instream: symbol not found Error relocating /usr/bin/entry: tilde_expansion_preexpansion_hook: symbol not found Error relocating /usr/bin/entry: tilde_additional_suffixes: symbol not found Error relocating /usr/bin/entry: rl_completion_suppress_append: symbol not found Error relocating /usr/bin/entry: history_inhibit_expansion_function: symbol not found Error relocating /usr/bin/entry: rl_completer_quote_characters: symbol not found Error relocating /usr/bin/entry: rl_completion_quote_character: symbol not found Error relocating /usr/bin/entry: history_base: symbol not found Error relocating /usr/bin/entry: rl_terminal_name: symbol not found Error relocating /usr/bin/entry: history_expansion_char: symbol not found Error relocating /usr/bin/entry: rl_outstream: symbol not found Error relocating /usr/bin/entry: emacs_standard_keymap: symbol not found Error relocating /usr/bin/entry: rl_startup_hook: symbol not found Error relocating /usr/bin/entry: history_quoting_state: symbol not found Error relocating /usr/bin/entry: rl_signal_event_hook: symbol not found Error relocating /usr/bin/entry: rl_special_prefixes: symbol not found Error relocating /usr/bin/entry: rl_explicit_arg: symbol not found Error relocating /usr/bin/entry: rl_num_chars_to_read: symbol not found Error relocating /usr/bin/entry: rl_completion_mark_symlink_dirs: symbol not found
[root@si0vm09262 bin]# ./ctr --address /run/k3s/containerd/containerd.sock --namespace k8s.io run --rm -t docker.io/rancher/klipper-helm:v0.7.6-build20230223 sh sh /home/klipper-helm $ ls sh: ls: Permission denied /home/klipper-helm $ entry sh: entry: Permission denied /home/klipper-helm $ /usr/bin/entry sh: /usr/bin/entry: Permission denied /home/klipper-helm $ exit [root@si0vm09262 bin]# ./ctr --address /run/k3s/containerd/containerd.sock --namespace k8s.io run --rm -t docker.io/rancher/klipper-helm:v0.7.6-build20230223 sh entry Error loading shared library libreadline.so.8: Permission denied (needed by /usr/bin/entry) Error relocating /usr/bin/entry: unstifle_history: symbol not found Error relocating /usr/bin/entry: rl_make_bare_keymap: symbol not found Error relocating /usr/bin/entry: rl_bind_key_if_unbound_in_map: symbol not found Error relocating /usr/bin/entry: rl_macro_dumper: symbol not found Error relocating /usr/bin/entry: previous_history: symbol not found Error relocating /usr/bin/entry: rl_vi_end_word: symbol not found Error relocating /usr/bin/entry: rl_parse_and_bind: symbol not found Error relocating /usr/bin/entry: rl_redisplay: symbol not found Error relocating /usr/bin/entry: rl_push_macro_input: symbol not found Error relocating /usr/bin/entry: rl_bind_key_in_map: symbol not found Error relocating /usr/bin/entry: clear_history: symbol not found Error relocating /usr/bin/entry: add_history: symbol not found Error relocating /usr/bin/entry: rl_redraw_prompt_last_line: symbol not found Error relocating /usr/bin/entry: rl_function_of_keyseq_len: symbol not found Error relocating /usr/bin/entry: history_get: symbol not found Error relocating /usr/bin/entry: rl_get_keymap: symbol not found Error relocating /usr/bin/entry: rl_kill_text: symbol not found Error relocating /usr/bin/entry: remove_history: symbol not found Error relocating /usr/bin/entry: history_truncate_file: symbol not found Error relocating /usr/bin/entry: rl_generic_bind: symbol not found Error relocating /usr/bin/entry: rl_read_key: symbol not found Error relocating /usr/bin/entry: read_history: symbol not found Error relocating /usr/bin/entry: rl_add_defun: symbol not found Error relocating /usr/bin/entry: history_expand: symbol not found Error relocating /usr/bin/entry: rl_translate_keyseq: symbol not found Error relocating /usr/bin/entry: rl_forced_update_display: symbol not found Error relocating /usr/bin/entry: rl_set_timeout: symbol not found Error relocating /usr/bin/entry: rl_read_init_file: symbol not found Error relocating /usr/bin/entry: rl_invoking_keyseqs: symbol not found Error relocating /usr/bin/entry: append_history: symbol not found Error relocating /usr/bin/entry: free_history_entry: symbol not found Error relocating /usr/bin/entry: rl_unbind_key_in_map: symbol not found Error relocating /usr/bin/entry: rl_set_signals: symbol not found Error relocating /usr/bin/entry: readline: symbol not found Error relocating /usr/bin/entry: rl_variable_value: symbol not found Error relocating /usr/bin/entry: history_set_pos: symbol not found Error relocating /usr/bin/entry: rl_unbind_function_in_map: symbol not found Error relocating /usr/bin/entry: read_history_range: symbol not found Error relocating /usr/bin/entry: history_is_stifled: symbol not found Error relocating /usr/bin/entry: stifle_history: symbol not found Error relocating /usr/bin/entry: replace_history_entry: symbol not found Error relocating /usr/bin/entry: rl_insert_text: symbol not found Error relocating /usr/bin/entry: rl_get_keymap_by_name: symbol not found Error relocating /usr/bin/entry: rl_set_screen_size: symbol not found Error relocating /usr/bin/entry: rl_clear_signals: symbol not found Error relocating /usr/bin/entry: rl_vi_bWord: symbol not found Error relocating /usr/bin/entry: rl_get_termcap: symbol not found Error relocating /usr/bin/entry: rl_begin_undo_group: symbol not found Error relocating /usr/bin/entry: rl_ding: symbol not found Error relocating /usr/bin/entry: where_history: symbol not found Error relocating /usr/bin/entry: rl_delete_text: symbol not found Error relocating /usr/bin/entry: rl_function_of_keyseq: symbol not found Error relocating /usr/bin/entry: rl_bind_keyseq: symbol not found Error relocating /usr/bin/entry: rl_reset_terminal: symbol not found Error relocating /usr/bin/entry: history_tokenize: symbol not found Error relocating /usr/bin/entry: rl_forward_word: symbol not found Error relocating /usr/bin/entry: rl_copy_text: symbol not found Error relocating /usr/bin/entry: rl_function_dumper: symbol not found Error relocating /usr/bin/entry: _rl_find_next_mbchar: symbol not found Error relocating /usr/bin/entry: rl_vi_insertion_mode: symbol not found Error relocating /usr/bin/entry: rl_end_undo_group: symbol not found Error relocating /usr/bin/entry: rl_variable_bind: symbol not found Error relocating /usr/bin/entry: rl_named_function: symbol not found Error relocating /usr/bin/entry: rl_initialize: symbol not found Error relocating /usr/bin/entry: rl_vi_start_inserting: symbol not found Error relocating /usr/bin/entry: rl_complete: symbol not found Error relocating /usr/bin/entry: rl_complete_internal: symbol not found Error relocating /usr/bin/entry: history_list: symbol not found Error relocating /usr/bin/entry: tilde_expand: symbol not found Error relocating /usr/bin/entry: rl_funmap_names: symbol not found Error relocating /usr/bin/entry: rl_set_keymap: symbol not found Error relocating /usr/bin/entry: rl_variable_dumper: symbol not found Error relocating /usr/bin/entry: rl_bind_keyseq_in_map: symbol not found Error relocating /usr/bin/entry: write_history: symbol not found Error relocating /usr/bin/entry: rl_on_new_line: symbol not found Error relocating /usr/bin/entry: rl_clear_visible_line: symbol not found Error relocating /usr/bin/entry: rl_completion_matches: symbol not found Error relocating /usr/bin/entry: rl_completion_mode: symbol not found Error relocating /usr/bin/entry: rl_add_undo: symbol not found Error relocating /usr/bin/entry: rl_cleanup_after_signal: symbol not found Error relocating /usr/bin/entry: rl_list_funmap_names: symbol not found Error relocating /usr/bin/entry: using_history: symbol not found Error relocating /usr/bin/entry: history_get_time: symbol not found Error relocating /usr/bin/entry: remove_history_range: symbol not found Error relocating /usr/bin/entry: rl_crlf: symbol not found Error relocating /usr/bin/entry: rl_trim_arg_from_keyseq: symbol not found Error relocating /usr/bin/entry: rl_emacs_editing_mode: symbol not found Error relocating /usr/bin/entry: rl_filename_completion_function: symbol not found Error relocating /usr/bin/entry: rl_tilde_expand: symbol not found Error relocating /usr/bin/entry: rl_newline: symbol not found Error relocating /usr/bin/entry: rl_vi_editing_mode: symbol not found Error relocating /usr/bin/entry: rl_username_completion_function: symbol not found Error relocating /usr/bin/entry: rl_insert: symbol not found Error relocating /usr/bin/entry: rl_tab_insert: symbol not found Error relocating /usr/bin/entry: rl_menu_complete: symbol not found Error relocating /usr/bin/entry: rl_yank_last_arg: symbol not found Error relocating /usr/bin/entry: rl_complete: symbol not found Error relocating /usr/bin/entry: history_length: symbol not found Error relocating /usr/bin/entry: rl_completion_found_quote: symbol not found Error relocating /usr/bin/entry: rl_completion_type: symbol not found Error relocating /usr/bin/entry: rl_point: symbol not found Error relocating /usr/bin/entry: history_lines_written_to_file: symbol not found Error relocating /usr/bin/entry: history_max_entries: symbol not found Error relocating /usr/bin/entry: history_write_timestamps: symbol not found Error relocating /usr/bin/entry: rl_completion_suppress_quote: symbol not found Error relocating /usr/bin/entry: rl_basic_word_break_characters: symbol not found Error relocating /usr/bin/entry: rl_mark: symbol not found Error relocating /usr/bin/entry: rl_directory_rewrite_hook: symbol not found Error relocating /usr/bin/entry: rl_end: symbol not found Error relocating /usr/bin/entry: rl_directory_completion_hook: symbol not found Error relocating /usr/bin/entry: rl_completer_word_break_characters: symbol not found Error relocating /usr/bin/entry: rl_dispatching: symbol not found Error relocating /usr/bin/entry: rl_filename_quoting_desired: symbol not found Error relocating /usr/bin/entry: history_search_delimiter_chars: symbol not found Error relocating /usr/bin/entry: rl_executing_keyseq: symbol not found Error relocating /usr/bin/entry: rl_key_sequence_length: symbol not found Error relocating /usr/bin/entry: rl_filename_dequoting_function: symbol not found Error relocating /usr/bin/entry: rl_filename_rewrite_hook: symbol not found Error relocating /usr/bin/entry: rl_filename_stat_hook: symbol not found Error relocating /usr/bin/entry: vi_insertion_keymap: symbol not found Error relocating /usr/bin/entry: rl_prep_term_function: symbol not found Error relocating /usr/bin/entry: rl_menu_completion_entry_function: symbol not found Error relocating /usr/bin/entry: rl_attempted_completion_function: symbol not found Error relocating /usr/bin/entry: history_comment_char: symbol not found Error relocating /usr/bin/entry: rl_filename_completion_desired: symbol not found Error relocating /usr/bin/entry: rl_done: symbol not found Error relocating /usr/bin/entry: rl_completion_append_character: symbol not found Error relocating /usr/bin/entry: rl_sort_completion_matches: symbol not found Error relocating /usr/bin/entry: history_lines_read_from_file: symbol not found Error relocating /usr/bin/entry: emacs_ctlx_keymap: symbol not found Error relocating /usr/bin/entry: rl_deprep_term_function: symbol not found Error relocating /usr/bin/entry: rl_editing_mode: symbol not found Error relocating /usr/bin/entry: tilde_additional_prefixes: symbol not found Error relocating /usr/bin/entry: history_subst_char: symbol not found Error relocating /usr/bin/entry: rl_readline_state: symbol not found Error relocating /usr/bin/entry: rl_attempted_completion_over: symbol not found Error relocating /usr/bin/entry: vi_movement_keymap: symbol not found Error relocating /usr/bin/entry: rl_filename_quote_characters: symbol not found Error relocating /usr/bin/entry: rl_filename_quoting_function: symbol not found Error relocating /usr/bin/entry: history_quotes_inhibit_expansion: symbol not found Error relocating /usr/bin/entry: rl_readline_name: symbol not found Error relocating /usr/bin/entry: rl_line_buffer: symbol not found Error relocating /usr/bin/entry: emacs_meta_keymap: symbol not found Error relocating /usr/bin/entry: rl_char_is_quoted_p: symbol not found Error relocating /usr/bin/entry: rl_completion_entry_function: symbol not found Error relocating /usr/bin/entry: rl_last_func: symbol not found Error relocating /usr/bin/entry: rl_ignore_some_completions_function: symbol not found Error relocating /usr/bin/entry: rl_completion_invoking_key: symbol not found Error relocating /usr/bin/entry: rl_instream: symbol not found Error relocating /usr/bin/entry: tilde_expansion_preexpansion_hook: symbol not found Error relocating /usr/bin/entry: tilde_additional_suffixes: symbol not found Error relocating /usr/bin/entry: rl_completion_suppress_append: symbol not found Error relocating /usr/bin/entry: history_inhibit_expansion_function: symbol not found Error relocating /usr/bin/entry: rl_completer_quote_characters: symbol not found Error relocating /usr/bin/entry: rl_completion_quote_character: symbol not found Error relocating /usr/bin/entry: history_base: symbol not found Error relocating /usr/bin/entry: rl_terminal_name: symbol not found Error relocating /usr/bin/entry: history_expansion_char: symbol not found Error relocating /usr/bin/entry: rl_outstream: symbol not found Error relocating /usr/bin/entry: emacs_standard_keymap: symbol not found Error relocating /usr/bin/entry: rl_startup_hook: symbol not found Error relocating /usr/bin/entry: history_quoting_state: symbol not found Error relocating /usr/bin/entry: rl_signal_event_hook: symbol not found Error relocating /usr/bin/entry: rl_special_prefixes: symbol not found Error relocating /usr/bin/entry: rl_explicit_arg: symbol not found Error relocating /usr/bin/entry: rl_num_chars_to_read: symbol not found Error relocating /usr/bin/entry: rl_completion_mark_symlink_dirs: symbol not found
cluster-cidr: "192.168.128.0/18" service-cidr: "192.168.0.0/17" disable-cloud-controller: true data-dir: "/net/si0vm09262/fs0/rke2-data"
[rbadmin_app2@si0vm09262 ~]$ sudo rke2 server WARN[0000] not running in CIS mode INFO[0000] Applying Pod Security Admission Configuration INFO[0000] Starting rke2 v1.27.1+rke2r1 (9ce3825ec005872a0873307844ba99a2bdd4ee19) INFO[0000] Managed etcd cluster initializing INFO[0000] generated self-signed CA certificate CN=rke2-client-ca@1684511734: notBefore=2023-05-19 15:55:34.647605491 +0000 UTC notAfter=2033-05-16 15:55:34.647605491 +0000 UTC INFO[0000] certificate CN=system:admin,O=system:masters signed by CN=rke2-client-ca@1684511734: notBefore=2023-05-19 15:55:34 +0000 UTC notAfter=2024-05-18 15:55:34 +0000 UTC INFO[0000] certificate CN=system:kube-controller-manager signed by CN=rke2-client-ca@1684511734: notBefore=2023-05-19 15:55:34 +0000 UTC notAfter=2024-05-18 15:55:34 +0000 UTC INFO[0000] certificate CN=system:kube-scheduler signed by CN=rke2-client-ca@1684511734: notBefore=2023-05-19 15:55:34 +0000 UTC notAfter=2024-05-18 15:55:34 +0000 UTC INFO[0000] certificate CN=system:apiserver,O=system:masters signed by CN=rke2-client-ca@1684511734: notBefore=2023-05-19 15:55:34 +0000 UTC notAfter=2024-05-18 15:55:34 +0000 UTC INFO[0000] certificate CN=system:kube-proxy signed by CN=rke2-client-ca@1684511734: notBefore=2023-05-19 15:55:34 +0000 UTC notAfter=2024-05-18 15:55:34 +0000 UTC INFO[0000] certificate CN=system:rke2-controller signed by CN=rke2-client-ca@1684511734: notBefore=2023-05-19 15:55:34 +0000 UTC notAfter=2024-05-18 15:55:34 +0000 UTC INFO[0000] certificate CN=rke2-cloud-controller-manager signed by CN=rke2-client-ca@1684511734: notBefore=2023-05-19 15:55:34 +0000 UTC notAfter=2024-05-18 15:55:34 +0000 UTC INFO[0000] generated self-signed CA certificate CN=rke2-server-ca@1684511734: notBefore=2023-05-19 15:55:34.658617311 +0000 UTC notAfter=2033-05-16 15:55:34.658617311 +0000 UTC INFO[0000] certificate CN=kube-apiserver signed by CN=rke2-server-ca@1684511734: notBefore=2023-05-19 15:55:34 +0000 UTC notAfter=2024-05-18 15:55:34 +0000 UTC INFO[0000] generated self-signed CA certificate CN=rke2-request-header-ca@1684511734: notBefore=2023-05-19 15:55:34.663565697 +0000 UTC notAfter=2033-05-16 15:55:34.663565697 +0000 UTC INFO[0000] certificate CN=system:auth-proxy signed by CN=rke2-request-header-ca@1684511734: notBefore=2023-05-19 15:55:34 +0000 UTC notAfter=2024-05-18 15:55:34 +0000 UTC INFO[0000] generated self-signed CA certificate CN=etcd-server-ca@1684511734: notBefore=2023-05-19 15:55:34.667765242 +0000 UTC notAfter=2033-05-16 15:55:34.667765242 +0000 UTC INFO[0000] certificate CN=etcd-server signed by CN=etcd-server-ca@1684511734: notBefore=2023-05-19 15:55:34 +0000 UTC notAfter=2024-05-18 15:55:34 +0000 UTC INFO[0000] certificate CN=etcd-client signed by CN=etcd-server-ca@1684511734: notBefore=2023-05-19 15:55:34 +0000 UTC notAfter=2024-05-18 15:55:34 +0000 UTC INFO[0000] generated self-signed CA certificate CN=etcd-peer-ca@1684511734: notBefore=2023-05-19 15:55:34.672640821 +0000 UTC notAfter=2033-05-16 15:55:34.672640821 +0000 UTC INFO[0000] certificate CN=etcd-peer signed by CN=etcd-peer-ca@1684511734: notBefore=2023-05-19 15:55:34 +0000 UTC notAfter=2024-05-18 15:55:34 +0000 UTC INFO[0000] Starting etcd for new cluster INFO[0000] start INFO[0000] schedule, now=2023-05-19T17:55:34+02:00, entry=1, next=2023-05-20T00:00:00+02:00 INFO[0000] certificate CN=rke2,O=rke2 signed by CN=rke2-server-ca@1684511734: notBefore=2023-05-19 15:55:34 +0000 UTC notAfter=2024-05-18 15:55:34 +0000 UTC INFO[0000] Active TLS secret / (ver=) (count 10): map[listener.cattle.io/cn-10.73.197.7:10.73.197.7 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-192.168.0.1:192.168.0.1 listener.cattle.io/cn-__1-f16284:::1 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-si0vm09262:si0vm09262 listener.cattle.io/fingerprint:SHA1=D3F5EF84CFA70C8871A4E91430A9C4B3D8A4F24E] INFO[0000] Tunnel server egress proxy mode: agent INFO[0000] Tunnel server egress proxy waiting for runtime core to become available INFO[0000] Running kube-apiserver --advertise-port=6443 --allow-privileged=true --anonymous-auth=false --api-audiences=https://kubernetes.default.svc.cluster.local,rke2 --authorization-mode=Node,RBAC --bind-address=0.0.0.0 --cert-dir=/net/si0vm09262/fs0/rke2-data/server/tls/temporary-certs --client-ca-file=/net/si0vm09262/fs0/rke2-data/server/tls/client-ca.crt --egress-selector-config-file=/net/si0vm09262/fs0/rke2-data/server/etc/egress-selector-config.yaml --enable-admission-plugins=NodeRestriction --enable-aggregator-routing=true --enable-bootstrap-token-auth=true --encryption-provider-config=/net/si0vm09262/fs0/rke2-data/server/cred/encryption-config.json --etcd-cafile=/net/si0vm09262/fs0/rke2-data/server/tls/etcd/server-ca.crt --etcd-certfile=/net/si0vm09262/fs0/rke2-data/server/tls/etcd/client.crt --etcd-keyfile=/net/si0vm09262/fs0/rke2-data/server/tls/etcd/client.key --etcd-servers=https://127.0.0.1:2379 --feature-gates=JobTrackingWithFinalizers=true --kubelet-certificate-authority=/net/si0vm09262/fs0/rke2-data/server/tls/server-ca.crt --kubelet-client-certificate=/net/si0vm09262/fs0/rke2-data/server/tls/client-kube-apiserver.crt --kubelet-client-key=/net/si0vm09262/fs0/rke2-data/server/tls/client-kube-apiserver.key --kubelet-preferred-address-types=InternalIP,ExternalIP,Hostname --profiling=false --proxy-client-cert-file=/net/si0vm09262/fs0/rke2-data/server/tls/client-auth-proxy.crt --proxy-client-key-file=/net/si0vm09262/fs0/rke2-data/server/tls/client-auth-proxy.key --requestheader-allowed-names=system:auth-proxy --requestheader-client-ca-file=/net/si0vm09262/fs0/rke2-data/server/tls/request-header-ca.crt --requestheader-extra-headers-prefix=X-Remote-Extra- --requestheader-group-headers=X-Remote-Group --requestheader-username-headers=X-Remote-User --secure-port=6443 --service-account-issuer=https://kubernetes.default.svc.cluster.local --service-account-key-file=/net/si0vm09262/fs0/rke2-data/server/tls/service.key --service-account-signing-key-file=/net/si0vm09262/fs0/rke2-data/server/tls/service.current.key --service-cluster-ip-range=192.168.0.0/17 --service-node-port-range=30000-32767 --storage-backend=etcd3 --tls-cert-file=/net/si0vm09262/fs0/rke2-data/server/tls/serving-kube-apiserver.crt --tls-cipher-suites=TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384,TLS_ECDHE_ECDSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256,TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305,TLS_ECDHE_RSA_WITH_CHACHA20_POLY1305 --tls-private-key-file=/net/si0vm09262/fs0/rke2-data/server/tls/serving-kube-apiserver.key INFO[0000] Running kube-scheduler --authentication-kubeconfig=/net/si0vm09262/fs0/rke2-data/server/cred/scheduler.kubeconfig --authorization-kubeconfig=/net/si0vm09262/fs0/rke2-data/server/cred/scheduler.kubeconfig --bind-address=127.0.0.1 --kubeconfig=/net/si0vm09262/fs0/rke2-data/server/cred/scheduler.kubeconfig --profiling=false --secure-port=10259 INFO[0000] Running kube-controller-manager --allocate-node-cidrs=true --authentication-kubeconfig=/net/si0vm09262/fs0/rke2-data/server/cred/controller.kubeconfig --authorization-kubeconfig=/net/si0vm09262/fs0/rke2-data/server/cred/controller.kubeconfig --bind-address=127.0.0.1 --cluster-cidr=192.168.128.0/18 --cluster-signing-kube-apiserver-client-cert-file=/net/si0vm09262/fs0/rke2-data/server/tls/client-ca.nochain.crt --cluster-signing-kube-apiserver-client-key-file=/net/si0vm09262/fs0/rke2-data/server/tls/client-ca.key --cluster-signing-kubelet-client-cert-file=/net/si0vm09262/fs0/rke2-data/server/tls/client-ca.nochain.crt --cluster-signing-kubelet-client-key-file=/net/si0vm09262/fs0/rke2-data/server/tls/client-ca.key --cluster-signing-kubelet-serving-cert-file=/net/si0vm09262/fs0/rke2-data/server/tls/server-ca.nochain.crt --cluster-signing-kubelet-serving-key-file=/net/si0vm09262/fs0/rke2-data/server/tls/server-ca.key --cluster-signing-legacy-unknown-cert-file=/net/si0vm09262/fs0/rke2-data/server/tls/server-ca.nochain.crt --cluster-signing-legacy-unknown-key-file=/net/si0vm09262/fs0/rke2-data/server/tls/server-ca.key --controllers=*,tokencleaner --feature-gates=JobTrackingWithFinalizers=true --kubeconfig=/net/si0vm09262/fs0/rke2-data/server/cred/controller.kubeconfig --profiling=false --root-ca-file=/net/si0vm09262/fs0/rke2-data/server/tls/server-ca.crt --secure-port=10257 --service-account-private-key-file=/net/si0vm09262/fs0/rke2-data/server/tls/service.current.key --service-cluster-ip-range=192.168.0.0/17 --use-service-account-credentials=true INFO[0000] Server node token is available at /net/si0vm09262/fs0/rke2-data/server/token INFO[0000] To join server node to cluster: rke2 server -s https://10.73.197.7:9345 -t ${SERVER_NODE_TOKEN} INFO[0000] Agent node token is available at /net/si0vm09262/fs0/rke2-data/server/agent-token INFO[0000] To join agent node to cluster: rke2 agent -s https://10.73.197.7:9345 -t ${AGENT_NODE_TOKEN} INFO[0000] Waiting for cri connection: rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing dial unix /run/k3s/containerd/containerd.sock: connect: no such file or directory" INFO[0000] Wrote kubeconfig /etc/rancher/rke2/rke2.yaml INFO[0000] Run: rke2 kubectl INFO[0000] certificate CN=si0vm09262 signed by CN=rke2-server-ca@1684511734: notBefore=2023-05-19 15:55:34 +0000 UTC notAfter=2024-05-18 15:55:34 +0000 UTC INFO[0000] certificate CN=system:node:si0vm09262,O=system:nodes signed by CN=rke2-client-ca@1684511734: notBefore=2023-05-19 15:55:34 +0000 UTC notAfter=2024-05-18 15:55:34 +0000 UTC INFO[0000] Module overlay was already loaded INFO[0000] Module br_netfilter was already loaded INFO[0000] Set sysctl 'net/netfilter/nf_conntrack_max' to 131072 INFO[0000] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400 INFO[0000] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600 INFO[0000] Checking local image archives in /net/si0vm09262/fs0/rke2-data/agent/images for index.docker.io/rancher/rke2-runtime:v1.27.1-rke2r1 INFO[0000] Creating directory /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/bin INFO[0000] Extracting file bin/containerd to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/bin/containerd INFO[0000] Extracting file bin/containerd-shim to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/bin/containerd-shim INFO[0000] Extracting file bin/containerd-shim-runc-v1 to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/bin/containerd-shim-runc-v1 INFO[0000] Extracting file bin/containerd-shim-runc-v2 to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/bin/containerd-shim-runc-v2 INFO[0000] Extracting file bin/crictl to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/bin/crictl INFO[0000] Extracting file bin/ctr to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/bin/ctr INFO[0000] Extracting file bin/kubectl to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/bin/kubectl INFO[0000] Extracting file bin/kubelet to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/bin/kubelet INFO[0000] Extracting file bin/runc to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/bin/runc INFO[0000] Creating directory /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/charts INFO[0000] Extracting file charts/harvester-cloud-provider.yaml to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/charts/harvester-cloud-provider.yaml INFO[0000] Extracting file charts/harvester-csi-driver.yaml to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/charts/harvester-csi-driver.yaml INFO[0000] Extracting file charts/rancher-vsphere-cpi.yaml to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/charts/rancher-vsphere-cpi.yaml INFO[0000] Extracting file charts/rancher-vsphere-csi.yaml to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/charts/rancher-vsphere-csi.yaml INFO[0000] Extracting file charts/rke2-calico-crd.yaml to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/charts/rke2-calico-crd.yaml INFO[0000] Extracting file charts/rke2-calico.yaml to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/charts/rke2-calico.yaml INFO[0000] Extracting file charts/rke2-canal.yaml to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/charts/rke2-canal.yaml INFO[0000] Extracting file charts/rke2-cilium.yaml to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/charts/rke2-cilium.yaml INFO[0000] Extracting file charts/rke2-coredns.yaml to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/charts/rke2-coredns.yaml INFO[0000] Extracting file charts/rke2-ingress-nginx.yaml to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/charts/rke2-ingress-nginx.yaml INFO[0000] Extracting file charts/rke2-metrics-server.yaml to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/charts/rke2-metrics-server.yaml INFO[0000] Extracting file charts/rke2-multus.yaml to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/charts/rke2-multus.yaml INFO[0000] Extracting file charts/rke2-snapshot-controller-crd.yaml to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/charts/rke2-snapshot-controller-crd.yaml INFO[0000] Extracting file charts/rke2-snapshot-controller.yaml to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/charts/rke2-snapshot-controller.yaml INFO[0000] Extracting file charts/rke2-snapshot-validation-webhook.yaml to /net/si0vm09262/fs0/rke2-data/data/v1.27.1-rke2r1-50476b816b44/charts/rke2-snapshot-validation-webhook.yaml INFO[0000] Updated manifest /net/si0vm09262/fs0/rke2-data/server/manifests/rke2-calico.yaml to set cluster configuration values INFO[0000] Updated manifest /net/si0vm09262/fs0/rke2-data/server/manifests/rke2-snapshot-controller-crd.yaml to set cluster configuration values INFO[0001] Updated manifest /net/si0vm09262/fs0/rke2-data/server/manifests/rke2-multus.yaml to set cluster configuration values INFO[0001] Updated manifest /net/si0vm09262/fs0/rke2-data/server/manifests/rke2-snapshot-controller.yaml to set cluster configuration values INFO[0001] Updated manifest /net/si0vm09262/fs0/rke2-data/server/manifests/rke2-snapshot-validation-webhook.yaml to set cluster configuration values INFO[0001] Updated manifest /net/si0vm09262/fs0/rke2-data/server/manifests/harvester-cloud-provider.yaml to set cluster configuration values INFO[0001] Updated manifest /net/si0vm09262/fs0/rke2-data/server/manifests/harvester-csi-driver.yaml to set cluster configuration values INFO[0001] Updated manifest /net/si0vm09262/fs0/rke2-data/server/manifests/rancher-vsphere-csi.yaml to set cluster configuration values INFO[0001] Updated manifest /net/si0vm09262/fs0/rke2-data/server/manifests/rke2-calico-crd.yaml to set cluster configuration values INFO[0001] Updated manifest /net/si0vm09262/fs0/rke2-data/server/manifests/rke2-coredns.yaml to set cluster configuration values INFO[0001] Updated manifest /net/si0vm09262/fs0/rke2-data/server/manifests/rke2-ingress-nginx.yaml to set cluster configuration values INFO[0001] Updated manifest /net/si0vm09262/fs0/rke2-data/server/manifests/rancher-vsphere-cpi.yaml to set cluster configuration values INFO[0001] Updated manifest /net/si0vm09262/fs0/rke2-data/server/manifests/rke2-canal.yaml to set cluster configuration values INFO[0001] Updated manifest /net/si0vm09262/fs0/rke2-data/server/manifests/rke2-cilium.yaml to set cluster configuration values INFO[0001] Updated manifest /net/si0vm09262/fs0/rke2-data/server/manifests/rke2-metrics-server.yaml to set cluster configuration values INFO[0001] Logging containerd to /net/si0vm09262/fs0/rke2-data/agent/containerd/containerd.log INFO[0001] Running containerd -c /net/si0vm09262/fs0/rke2-data/agent/etc/containerd/config.toml -a /run/k3s/containerd/containerd.sock --state /run/k3s/containerd --root /net/si0vm09262/fs0/rke2-data/agent/containerd INFO[0002] containerd is now running INFO[0002] Importing images from /net/si0vm09262/fs0/rke2-data/agent/images/rke2-images.linux-amd64.tar INFO[0005] Tunnel server egress proxy waiting for runtime core to become available INFO[0010] Tunnel server egress proxy waiting for runtime core to become available {"level":"warn","ts":"2023-05-19T17:55:49.771+0200","logger":"etcd-client","caller":"v3@v3.5.7-k3s1/retry_interceptor.go:62","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0xc000a08000/127.0.0.1:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest balancer error: last connection error: connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused\""} {"level":"info","ts":"2023-05-19T17:55:49.771+0200","logger":"etcd-client","caller":"v3@v3.5.7-k3s1/client.go:210","msg":"Auto sync endpoints failed.","error":"context deadline exceeded"} INFO[0015] Tunnel server egress proxy waiting for runtime core to become available INFO[0020] Tunnel server egress proxy waiting for runtime core to become available INFO[0020] Container for etcd not found (no matching container found), retrying INFO[0025] Tunnel server egress proxy waiting for runtime core to become available {"level":"warn","ts":"2023-05-19T17:56:04.773+0200","logger":"etcd-client","caller":"v3@v3.5.7-k3s1/retry_interceptor.go:62","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0xc000a08000/127.0.0.1:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest balancer error: last connection error: connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused\""} {"level":"info","ts":"2023-05-19T17:56:04.773+0200","logger":"etcd-client","caller":"v3@v3.5.7-k3s1/client.go:210","msg":"Auto sync endpoints failed.","error":"context deadline exceeded"} {"level":"warn","ts":"2023-05-19T17:56:04.783+0200","logger":"etcd-client","caller":"v3@v3.5.7-k3s1/retry_interceptor.go:62","msg":"retrying of unary invoker failed","target":"etcd-endpoints://0xc000a08000/127.0.0.1:2379","attempt":0,"error":"rpc error: code = DeadlineExceeded desc = latest balancer error: last connection error: connection error: desc = \"transport: Error while dialing dial tcp 127.0.0.1:2379: connect: connection refused\""} INFO[0030] Failed to test data store connection: context deadline exceeded INFO[0030] Tunnel server egress proxy waiting for runtime core to become available INFO[0030] Waiting for etcd server to become available INFO[0035] Tunnel server egress proxy waiting for runtime core to become available INFO[0039] Imported docker.io/rancher/hardened-k8s-metrics-server:v0.6.2-build20221202 INFO[0039] Imported docker.io/rancher/klipper-lb:v0.4.3 INFO[0039] Imported docker.io/rancher/hardened-kubernetes:v1.27.1-rke2r1-build20230418 INFO[0039] Imported docker.io/rancher/hardened-cluster-autoscaler:v1.8.6-build20230406 INFO[0039] Imported docker.io/rancher/pause:3.6 INFO[0039] Imported docker.io/rancher/hardened-calico:v3.25.0-build20230209 INFO[0039] Imported docker.io/rancher/rke2-runtime:v1.27.1-rke2r1 INFO[0039] Imported docker.io/rancher/hardened-dns-node-cache:1.22.20-build20230406 INFO[0039] Imported docker.io/rancher/mirrored-sig-storage-snapshot-controller:v6.2.1 INFO[0039] Imported docker.io/rancher/mirrored-sig-storage-snapshot-validation-webhook:v6.2.1 INFO[0039] Imported docker.io/rancher/hardened-flannel:v0.21.3-build20230308 INFO[0039] Imported docker.io/rancher/mirrored-ingress-nginx-kube-webhook-certgen:v20230312-helm-chart-4.5.2-28-g66a760794 INFO[0039] Imported docker.io/rancher/rke2-cloud-provider:v1.26.3-build20230406 INFO[0039] Imported docker.io/rancher/klipper-helm:v0.7.6-build20230223 INFO[0039] Imported docker.io/rancher/nginx-ingress-controller:nginx-1.6.4-hardened4 INFO[0039] Imported docker.io/rancher/hardened-coredns:v1.10.1-build20230406 INFO[0039] Imported docker.io/rancher/hardened-etcd:v3.5.7-k3s1-build20230406 INFO[0039] Imported images from /net/si0vm09262/fs0/rke2-data/agent/images/rke2-images.linux-amd64.tar in 37.326390226s INFO[0039] Running kubelet --address=0.0.0.0 --alsologtostderr=false --anonymous-auth=false --authentication-token-webhook=true --authorization-mode=Webhook --cgroup-driver=cgroupfs --client-ca-file=/net/si0vm09262/fs0/rke2-data/agent/client-ca.crt --cluster-dns=192.168.0.10 --cluster-domain=cluster.local --container-runtime-endpoint=unix:///run/k3s/containerd/containerd.sock --containerd=/run/k3s/containerd/containerd.sock --eviction-hard=imagefs.available<5%,nodefs.available<5% --eviction-minimum-reclaim=imagefs.available=10%,nodefs.available=10% --fail-swap-on=false --healthz-bind-address=127.0.0.1 --hostname-override=si0vm09262 --kubeconfig=/net/si0vm09262/fs0/rke2-data/agent/kubelet.kubeconfig --kubelet-cgroups=/rke2 --log-file=/net/si0vm09262/fs0/rke2-data/agent/logs/kubelet.log --log-file-max-size=50 --logtostderr=false --node-labels= --pod-infra-container-image=index.docker.io/rancher/pause:3.6 --pod-manifest-path=/net/si0vm09262/fs0/rke2-data/agent/pod-manifests --read-only-port=0 --resolv-conf=/etc/resolv.conf --serialize-image-pulls=false --stderrthreshold=FATAL --tls-cert-file=/net/si0vm09262/fs0/rke2-data/agent/serving-kubelet.crt --tls-private-key-file=/net/si0vm09262/fs0/rke2-data/agent/serving-kubelet.key INFO[0039] Connecting to proxy url="wss://127.0.0.1:9345/v1-rke2/connect" INFO[0039] Handling backend connection request [si0vm09262] INFO[0039] Waiting to retrieve kube-proxy configuration; server is not ready: https://127.0.0.1:9345/v1-rke2/readyz: 500 Internal Server Error INFO[0040] Tunnel server egress proxy waiting for runtime core to become available INFO[0040] Container for etcd not found (no matching container found), retrying INFO[0043] Defragmenting etcd database INFO[0044] etcd data store connection OK INFO[0044] Saving cluster bootstrap data to datastore INFO[0044] Waiting for API server to become available INFO[0044] Reconciling etcd snapshot data in rke2-etcd-snapshots ConfigMap INFO[0044] Waiting to retrieve kube-proxy configuration; server is not ready: https://127.0.0.1:9345/v1-rke2/readyz: 500 Internal Server Error INFO[0045] Tunnel server egress proxy waiting for runtime core to become available INFO[0049] Waiting to retrieve kube-proxy configuration; server is not ready: https://127.0.0.1:9345/v1-rke2/readyz: 500 Internal Server Error INFO[0050] Tunnel server egress proxy waiting for runtime core to become available INFO[0051] Applying Cluster Role Bindings INFO[0051] Watching for delete of si0vm09262 Node object INFO[0051] Kube API server is now running INFO[0051] Applying CRD addons.k3s.cattle.io INFO[0051] Applying CRD helmcharts.helm.cattle.io INFO[0051] Applying CRD helmchartconfigs.helm.cattle.io INFO[0051] Waiting for CRD helmchartconfigs.helm.cattle.io to become available INFO[0051] Done waiting for CRD helmchartconfigs.helm.cattle.io to become available INFO[0052] Annotations and labels have been set successfully on node: si0vm09262 INFO[0054] Cluster Role Bindings applied successfully INFO[0054] Waiting to retrieve kube-proxy configuration; server is not ready: https://127.0.0.1:9345/v1-rke2/readyz: 500 Internal Server Error INFO[0055] Tunnel server egress proxy waiting for runtime core to become available INFO[0055] Stopped tunnel to 127.0.0.1:9345 INFO[0055] Proxy done err="context canceled" url="wss://127.0.0.1:9345/v1-rke2/connect" INFO[0055] Connecting to proxy url="wss://10.73.197.7:9345/v1-rke2/connect" INFO[0055] error in remotedialer server [400]: websocket: close 1006 (abnormal closure): unexpected EOF INFO[0055] Handling backend connection request [si0vm09262] INFO[0059] Waiting to retrieve kube-proxy configuration; server is not ready: https://127.0.0.1:9345/v1-rke2/readyz: 500 Internal Server Error INFO[0060] Container for etcd is running INFO[0060] Tunnel server egress proxy waiting for runtime core to become available INFO[0060] Container for kube-apiserver is running INFO[0060] ETCD server is now running INFO[0060] rke2 is up and running INFO[0060] Failed to get existing traefik HelmChart error="helmcharts.helm.cattle.io \"traefik\" not found" INFO[0060] Starting managed etcd node metadata controller INFO[0060] Reconciliation of snapshot data in rke2-etcd-snapshots ConfigMap complete ERRO[0060] Failed to record snapshots for cluster: No snapshot configmap found INFO[0060] Starting k3s.cattle.io/v1, Kind=Addon controller INFO[0060] Creating deploy event broadcaster INFO[0060] Starting /v1, Kind=Node controller INFO[0060] Cluster dns configmap has been set successfully INFO[0060] Starting managed etcd apiserver addresses controller INFO[0060] Starting managed etcd member removal controller INFO[0060] Creating helm-controller event broadcaster INFO[0060] Creating reencrypt-controller event broadcaster INFO[0061] Starting helm.cattle.io/v1, Kind=HelmChart controller INFO[0061] Starting helm.cattle.io/v1, Kind=HelmChartConfig controller INFO[0061] Starting rbac.authorization.k8s.io/v1, Kind=ClusterRoleBinding controller INFO[0061] Starting batch/v1, Kind=Job controller ERRO[0061] error syncing 'kube-system/rke2-ingress-nginx': handler helm-controller-chart-registration: helmcharts.helm.cattle.io "rke2-ingress-nginx" not found, requeuing ERRO[0061] error syncing 'kube-system/rke2-coredns': handler helm-controller-chart-registration: helmcharts.helm.cattle.io "rke2-coredns" not found, requeuing INFO[0061] Starting /v1, Kind=Secret controller INFO[0061] Starting /v1, Kind=ConfigMap controller INFO[0061] Starting /v1, Kind=ServiceAccount controller ERRO[0061] error syncing 'kube-system/rke2-canal': handler helm-controller-chart-registration: helmcharts.helm.cattle.io "rke2-canal" not found, requeuing INFO[0062] Updating TLS secret for kube-system/rke2-serving (count: 10): map[listener.cattle.io/cn-10.73.197.7:10.73.197.7 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-192.168.0.1:192.168.0.1 listener.cattle.io/cn-1-f16284:::1 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-si0vm09262:si0vm09262 listener.cattle.io/fingerprint:SHA1=D3F5EF84CFA70C8871A4E91430A9C4B3D8A4F24E] INFO[0062] Labels and annotations have been set successfully on node: si0vm09262 INFO[0062] Active TLS secret kube-system/rke2-serving (ver=347) (count 10): map[listener.cattle.io/cn-10.73.197.7:10.73.197.7 listener.cattle.io/cn-127.0.0.1:127.0.0.1 listener.cattle.io/cn-192.168.0.1:192.168.0.1 listener.cattle.io/cn-1-f16284:::1 listener.cattle.io/cn-kubernetes:kubernetes listener.cattle.io/cn-kubernetes.default:kubernetes.default listener.cattle.io/cn-kubernetes.default.svc:kubernetes.default.svc listener.cattle.io/cn-kubernetes.default.svc.cluster.local:kubernetes.default.svc.cluster.local listener.cattle.io/cn-localhost:localhost listener.cattle.io/cn-si0vm09262:si0vm09262 listener.cattle.io/fingerprint:SHA1=D3F5EF84CFA70C8871A4E91430A9C4B3D8A4F24E] INFO[0064] Running kube-proxy --cluster-cidr=192.168.128.0/18 --conntrack-max-per-core=0 --conntrack-tcp-timeout-close-wait=0s --conntrack-tcp-timeout-established=0s --healthz-bind-address=127.0.0.1 --hostname-override=si0vm09262 --kubeconfig=/net/si0vm09262/fs0/rke2-data/agent/kubeproxy.kubeconfig --proxy-mode=iptables ERRO[0065] error syncing 'kube-system/rke2-metrics-server': handler helm-controller-chart-registration: helmcharts.helm.cattle.io "rke2-metrics-server" not found, requeuing ERRO[0065] error syncing 'kube-system/rke2-snapshot-controller-crd': handler helm-controller-chart-registration: helmcharts.helm.cattle.io "rke2-snapshot-controller-crd" not found, requeuing ERRO[0065] error syncing 'kube-system/rke2-snapshot-controller': handler helm-controller-chart-registration: helmcharts.helm.cattle.io "rke2-snapshot-controller" not found, requeuing ERRO[0066] error syncing 'kube-system/rke2-snapshot-validation-webhook': handler helm-controller-chart-registration: helmcharts.helm.cattle.io "rke2-snapshot-validation-webhook" not found, requeuing