deepflowio / deepflow

eBPF Observability - Distributed Tracing and Profiling
https://deepflow.io
Apache License 2.0
2.96k stars 333 forks source link

[BUG] ebpf不支持4.14.105 #6331

Closed qyzhaoxun closed 6 months ago

qyzhaoxun commented 6 months ago

Search before asking

DeepFlow Component

Agent

What you expected to happen

ebpf采集可以支持4.14内核tlinux2.2

How to reproduce

os使用tlinux2.2

DeepFlow version

deepflow-agent -v

9830-284d3dbbf93c7cb028232d3e9cd20bc1181d449d Name: deepflow-agent community edition Branch: v6.4 CommitId: 284d3dbbf93c7cb028232d3e9cd20bc1181d449d RevCount: 9830 Compiler: rustc 1.75.0 (82e1608df 2023-12-21) CompileTime: 2024-04-30 05:03:06

DeepFlow agent list

No response

Kubernetes CNI

No response

Operation-System/Kernel version

awk -F '=' '/PRETTY_NAME/ { print $2 }' /etc/os-release

"Tencent tlinux 2.2 (Final)"

uname -r

4.14.105-1-tlinux3-0023.1

Anything else

deepflow-agent 日志

[2024-05-06 23:05:33.522024 +08:00] INFO [src/ebpf_dispatcher/ebpf_dispatcher.rs:657] ebpf collector init... [2024-05-06 23:05:33.522150 +08:00] INFO [src/ebpf_dispatcher/ebpf_dispatcher.rs:405] ebpf golang uprobe proc regexp is empty, skip set [2024-05-06 23:05:33.522231 +08:00] INFO [src/ebpf_dispatcher/ebpf_dispatcher.rs:421] ebpf openssl uprobe proc regexp is empty, skip set [2024-05-06 23:05:33.522320 +08:00] INFO [src/ebpf_dispatcher/ebpf_dispatcher.rs:444] ebpf golang symbol proc regexp is empty, skip set [2024-05-06 23:05:33.522394 +08:00] INFO [src/ebpf_dispatcher/ebpf_dispatcher.rs:449] l7 protocol Custom parse enabled [2024-05-06 23:05:33.522485 +08:00] INFO [src/ebpf_dispatcher/ebpf_dispatcher.rs:449] l7 protocol Http1 parse enabled [2024-05-06 23:05:33.522563 +08:00] INFO [src/ebpf_dispatcher/ebpf_dispatcher.rs:449] l7 protocol Http2 parse enabled [2024-05-06 23:05:33.522647 +08:00] INFO [src/ebpf_dispatcher/ebpf_dispatcher.rs:449] l7 protocol DNS parse enabled [2024-05-06 23:05:33.522718 +08:00] INFO [src/ebpf_dispatcher/ebpf_dispatcher.rs:449] l7 protocol SofaRPC parse enabled [2024-05-06 23:05:33.522800 +08:00] INFO [src/ebpf_dispatcher/ebpf_dispatcher.rs:449] l7 protocol MySQL parse enabled [2024-05-06 23:05:33.522870 +08:00] INFO [src/ebpf_dispatcher/ebpf_dispatcher.rs:449] l7 protocol Kafka parse enabled [2024-05-06 23:05:33.522959 +08:00] INFO [src/ebpf_dispatcher/ebpf_dispatcher.rs:449] l7 protocol Redis parse enabled [2024-05-06 23:05:33.523027 +08:00] INFO [src/ebpf_dispatcher/ebpf_dispatcher.rs:449] l7 protocol MongoDB parse enabled [2024-05-06 23:05:33.523105 +08:00] INFO [src/ebpf_dispatcher/ebpf_dispatcher.rs:449] l7 protocol PostgreSQL parse enabled [2024-05-06 23:05:33.523183 +08:00] INFO [src/ebpf_dispatcher/ebpf_dispatcher.rs:449] l7 protocol Dubbo parse enabled [2024-05-06 23:05:33.523263 +08:00] INFO [src/ebpf_dispatcher/ebpf_dispatcher.rs:449] l7 protocol FastCGI parse enabled [2024-05-06 23:05:33.523349 +08:00] INFO [src/ebpf_dispatcher/ebpf_dispatcher.rs:449] l7 protocol Oracle parse enabled [2024-05-06 23:05:33.523449 +08:00] INFO [src/ebpf_dispatcher/ebpf_dispatcher.rs:449] l7 protocol MQTT parse enabled [2024-05-06 23:05:33.523529 +08:00] INFO [src/ebpf_dispatcher/ebpf_dispatcher.rs:449] l7 protocol TLS parse enabled [2024-05-06 23:05:33.523672 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Currently "/proc/sys/net/core/bpf_jit_enable" value is 1, not need set. [2024-05-06 23:05:33.523792 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO log2_default_hugepage_sz 21 [2024-05-06 23:05:33.523908 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO linux version : 4.14.105-1-tlinux3-0023.1 (version code : 265833) [2024-05-06 23:05:33.523989 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO RLIMIT_NOFILE cur:1048576, rlim_max:1048576 [2024-05-06 23:05:33.524117 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO sys_boot_time_ns : 1714977119605591628 [2024-05-06 23:05:33.524294 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO [deepflow-ebpfctl] sockopt register succeed, type get: 404 - 404 set: 400 - 403 [2024-05-06 23:05:33.524452 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO register_period_event_op 'kick_kern' succeed. [2024-05-06 23:05:33.524531 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO register_period_event_op 'boot time update' succeed. [2024-05-06 23:05:33.524671 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Tracer 'socket-trace', Not Found. [2024-05-06 23:05:33.524744 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Tracer 'socket-trace', Not Found. [2024-05-06 23:05:33.524828 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Tracer 'socket-trace', Not Found. [2024-05-06 23:05:33.525062 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Set ports_bitmap[DNS] success, ports 53,5353 [2024-05-06 23:05:33.525257 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Set ports_bitmap[TLS] success, ports 443,6443 [2024-05-06 23:05:33.525506 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Set ports_bitmap[FastCGI] success, ports 1-65535 [2024-05-06 23:05:33.525757 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Set ports_bitmap[HTTP1] success, ports 1-65535 [2024-05-06 23:05:33.526003 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Set ports_bitmap[MySQL] success, ports 1-65535 [2024-05-06 23:05:33.526244 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Set ports_bitmap[Oracle] success, ports 1-65535 [2024-05-06 23:05:33.526485 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Set ports_bitmap[PgSQL] success, ports 1-65535 [2024-05-06 23:05:33.526732 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Set ports_bitmap[MongoDB] success, ports 1-65535 [2024-05-06 23:05:33.526979 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Set ports_bitmap[MQTT] success, ports 1-65535 [2024-05-06 23:05:33.527237 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Set ports_bitmap[HTTP2] success, ports 1-65535 [2024-05-06 23:05:33.527501 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Set ports_bitmap[Custom] success, ports 1-65535 [2024-05-06 23:05:33.527767 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Set ports_bitmap[Kafka] success, ports 1-65535 [2024-05-06 23:05:33.528045 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Set ports_bitmap[Redis] success, ports 1-65535 [2024-05-06 23:05:33.528324 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Set ports_bitmap[Dubbo] success, ports 1-65535 [2024-05-06 23:05:33.528588 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Set ports_bitmap[SofaRPC] success, ports 1-65535 [2024-05-06 23:05:33.528670 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO check_kernel_version Linux 4.14.105-1 [2024-05-06 23:05:33.535815 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Tracer 'socket-trace', Not Found. [2024-05-06 23:05:33.536177 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO license: GPL [2024-05-06 23:05:33.536793 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Update map ("socket_info_map"), set max_entries 524288 [2024-05-06 23:05:33.536924 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Update map ("trace_map"), set max_entries 524288 [2024-05-06 23:05:33.627294 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Kernel not support interfaces bpf_probe_read{kernel,user}[_str] [2024-05-06 23:05:34.636341 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO bpf load "socket-trace-bpf-linux-common" succeed. [2024-05-06 23:05:34.636437 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Perf buffer reader cpu(0) -> queue(0) [2024-05-06 23:05:34.636646 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Perf buffer reader cpu(1) -> queue(0) [2024-05-06 23:05:34.636849 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO btf_vmlinux is null. [2024-05-06 23:05:34.636877 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO [eBPF Kernel Adapt] Set offsets map from btf_vmlinux, not support. [2024-05-06 23:05:34.636935 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Received limit_size (0), the final value is set to '4096' [2024-05-06 23:05:34.636976 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Insert into map('progs_jmp_tp_map'), key 0, program name bpf_prog_tpproto_infer_2 [2024-05-06 23:05:34.637001 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Insert into map('progs_jmp_tp_map'), key 1, program name bpf_prog_tp__data_submit [2024-05-06 23:05:34.637021 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Insert into map('progs_jmp_tp_map'), key 2, program name bpf_prog_tpoutput_data [2024-05-06 23:05:34.637045 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Insert into map('__progs_jmp_tp_map'), key 3, program name bpf_prog_tpio_event [2024-05-06 23:05:34.637068 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Insert into map('progs_jmp_kp_map'), key 0, program name bpf_prog_kpproto_infer_2 [2024-05-06 23:05:34.637088 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Insert into map('progs_jmp_kp_map'), key 1, program name bpf_prog_kpdata_submit [2024-05-06 23:05:34.637111 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Insert into map('progs_jmp_kp_map'), key 2, program name bpf_prog_kp__output_data [2024-05-06 23:05:34.637133 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Insert adapt kern uid : 264993 , 267558 [2024-05-06 23:05:34.637442 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO config_proto_ports_bitmap, update eBPF ports_bitmap[HTTP1] success. [2024-05-06 23:05:34.637474 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO config_proto_ports_bitmap, update eBPF ports_bitmap[HTTP2] success. [2024-05-06 23:05:34.637496 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO config_proto_ports_bitmap, update eBPF ports_bitmap[Dubbo] success. [2024-05-06 23:05:34.637522 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO config_proto_ports_bitmap, update eBPF ports_bitmap[SofaRPC] success. [2024-05-06 23:05:34.637547 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO config_proto_ports_bitmap, update eBPF ports_bitmap[FastCGI] success. [2024-05-06 23:05:34.637569 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO config_proto_ports_bitmap, update eBPF ports_bitmap[MySQL] success. [2024-05-06 23:05:34.637619 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO config_proto_ports_bitmap, update eBPF ports_bitmap[PgSQL] success. [2024-05-06 23:05:34.637645 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO config_proto_ports_bitmap, update eBPF ports_bitmap[Oracle] success. [2024-05-06 23:05:34.637670 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO config_proto_ports_bitmap, update eBPF ports_bitmap[Redis] success. [2024-05-06 23:05:34.637692 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO config_proto_ports_bitmap, update eBPF ports_bitmap[MongoDB] success. [2024-05-06 23:05:34.637717 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO config_proto_ports_bitmap, update eBPF ports_bitmap[Kafka] success. [2024-05-06 23:05:34.637739 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO config_proto_ports_bitmap, update eBPF ports_bitmap[MQTT] success. [2024-05-06 23:05:34.637765 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO config_proto_ports_bitmap, update eBPF ports_bitmap[DNS] success. [2024-05-06 23:05:34.637790 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO config_proto_ports_bitmap, update eBPF ports_bitmap[TLS] success. [2024-05-06 23:05:34.637827 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO config_proto_ports_bitmap, update eBPF ports_bitmap[Custom] success. [2024-05-06 23:05:34.637847 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO tracer(socket-trace) attach ... [2024-05-06 23:05:34.645541 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach enter kprobe: 'kprobe/sys_sendmsg', success! [2024-05-06 23:05:34.653891 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach enter kprobe: 'kprobe/sys_sendmmsg', success! [2024-05-06 23:05:34.662547 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach enter kprobe: 'kprobe/__sys_recvmsg', success! [2024-05-06 23:05:34.671495 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach enter kprobe: 'kprobe/sys_recvmmsg', success! [2024-05-06 23:05:34.677176 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach enter kprobe: 'kprobe/do_writev', success! [2024-05-06 23:05:34.683062 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach enter kprobe: 'kprobe/do_readv', success! [2024-05-06 23:05:34.683308 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_enter_write', succeed! [2024-05-06 23:05:34.683389 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_enter_read', succeed! [2024-05-06 23:05:34.683440 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_enter_sendto', succeed! [2024-05-06 23:05:34.683518 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_enter_recvfrom', succeed! [2024-05-06 23:05:34.683605 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_enter_connect', succeed! [2024-05-06 23:05:34.683684 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_exit_socket', succeed! [2024-05-06 23:05:34.683781 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_exit_read', succeed! [2024-05-06 23:05:34.683923 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_exit_write', succeed! [2024-05-06 23:05:34.683978 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_exit_sendto', succeed! [2024-05-06 23:05:34.684027 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_exit_recvfrom', succeed! [2024-05-06 23:05:34.684072 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_exit_sendmsg', succeed! [2024-05-06 23:05:34.684121 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_exit_sendmmsg', succeed! [2024-05-06 23:05:34.684170 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_exit_recvmsg', succeed! [2024-05-06 23:05:34.684218 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_exit_recvmmsg', succeed! [2024-05-06 23:05:34.684275 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_exit_writev', succeed! [2024-05-06 23:05:34.684330 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_exit_readv', succeed! [2024-05-06 23:05:34.684379 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_exit_accept', succeed! [2024-05-06 23:05:34.684428 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_exit_accept4', succeed! [2024-05-06 23:05:34.684500 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/sched/sched_process_fork', succeed! [2024-05-06 23:05:34.684566 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/sched/sched_process_exec', succeed! [2024-05-06 23:05:34.684625 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_enter_getppid', succeed! [2024-05-06 23:05:34.684681 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_enter_close', succeed! [2024-05-06 23:05:34.684752 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/syscalls/sys_exit_close', succeed! [2024-05-06 23:05:34.684818 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach tracepoint: 'tracepoint/sched/sched_process_exit', succeed! [2024-05-06 23:05:34.684847 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Successfully completed attach. [2024-05-06 23:05:34.685080 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO thread sk-reader-0, detached successful. [2024-05-06 23:05:34.685144 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO register_extra_waiting_op 'offset-infer-server' succeed. [2024-05-06 23:05:34.685186 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO register_extra_waiting_op 'offset-infer-client' succeed. [2024-05-06 23:05:34.685208 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO register_period_event_op 'check-map-exceeded' succeed. [2024-05-06 23:05:34.685230 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO register_period_event_op 'check-kern-adapt' succeed. [2024-05-06 23:05:34.685255 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO [deepflow-ebpfctl] sockopt register succeed, type get: 504 - 504 set: 500 - 503 [2024-05-06 23:05:34.685280 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO [deepflow-ebpfctl] sockopt register succeed, type get: 603 - 603 set: 600 - 602 [2024-05-06 23:05:34.685359 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO check_kernel_version Linux 4.14.105-1 [2024-05-06 23:05:34.747803 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO set java_syms_write_bytes_max : 10178560 [2024-05-06 23:05:34.747890 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO set java_syms_update_delay : 600 [2024-05-06 23:05:34.747917 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO [CP] Set 'cpu_aggregation_flag' successful, value 0 [2024-05-06 23:05:34.748464 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Tracer 'continuous_profiler', Not Found. [2024-05-06 23:05:34.748648 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO license: GPL [2024-05-06 23:05:34.789838 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO bpf load "continuous_profiler" succeed. [2024-05-06 23:05:34.789936 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO set_enable_perf_sample() success, enable_flag:0 [2024-05-06 23:05:34.789975 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Perf buffer reader cpu(0) -> queue(0) [2024-05-06 23:05:34.790075 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Perf buffer reader cpu(1) -> queue(0) [2024-05-06 23:05:34.790136 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Perf buffer reader cpu(0) -> queue(0) [2024-05-06 23:05:34.790202 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Perf buffer reader cpu(1) -> queue(0) [2024-05-06 23:05:34.795044 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO tracer(continuous_profiler) attach ... [2024-05-06 23:05:34.795152 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach perf event sample_freq 99 pid -1 cpu 0 done [2024-05-06 23:05:34.795198 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO attach perf event sample_freq 99 pid -1 cpu 1 done [2024-05-06 23:05:34.795220 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO tracer "continuous_profiler" attach perf event prog successful. [2024-05-06 23:05:34.795236 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Successfully completed attach. [2024-05-06 23:05:34.795314 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO thread java_update, detached successful. [2024-05-06 23:05:34.795377 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO thread cp_reader-0, detached successful. [2024-05-06 23:05:34.795397 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO [deepflow-ebpfctl] sockopt register succeed, type get: 703 - 703 set: 700 - 702 [2024-05-06 23:05:34.795434 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO [CP] Set 'profiler_regex' successful, pattern : '^deepflow-.*' [2024-05-06 23:05:34.795458 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO [CP] Set 'cpu_aggregation_flag' successful, value 0 [2024-05-06 23:05:34.795474 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO All tracers finish!!! [2024-05-06 23:05:34.795501 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO Received limit_size (8192), the final value is set to '8192' [2024-05-06 23:05:34.795555 +08:00] INFO [src/ebpf_dispatcher/ebpf_dispatcher.rs:672] ebpf collector initialized. [2024-05-06 23:05:34.795579 +08:00] INFO [src/rpc/synchronizer.rs:524] Reset version of acls, groups and platform_data. [2024-05-06 23:05:34.795705 +08:00] INFO [src/rpc/synchronizer.rs:524] Reset version of acls, groups and platform_data. [2024-05-06 23:05:34.795765 +08:00] INFO [src/trident.rs:2573] Staring agent components. [2024-05-06 23:05:34.795827 +08:00] INFO [src/platform/platform_synchronizer/linux.rs:983] socket info sync start [2024-05-06 23:05:34.795853 +08:00] INFO [src/platform/kubernetes/active_poller.rs:255] starts kubernetes active poller [2024-05-06 23:05:34.795908 +08:00] INFO [src/platform/prometheus/targets.rs:140] prometheus watcher is starting [2024-05-06 23:05:34.795933 +08:00] INFO [src/platform/prometheus/targets.rs:146] did not turn on the kubernetes_api_enabled switch, or the environment is not suitable for the prometheus collection [2024-05-06 23:05:34.795976 +08:00] INFO [src/debug/debugger.rs:393] debugger started [2024-05-06 23:05:34.796025 +08:00] INFO [src/sender/uniform_sender.rs:242] 3-doc-to-collector-sender uniform sender id: 3 started [2024-05-06 23:05:34.796074 +08:00] INFO [src/sender/uniform_sender.rs:242] 2-protolog-to-collector-sender uniform sender id: 4 started [2024-05-06 23:05:34.796127 +08:00] INFO [src/sender/uniform_sender.rs:242] 3-flowlog-to-collector-sender uniform sender id: 2 started [2024-05-06 23:05:34.796185 +08:00] INFO [src/sender/uniform_sender.rs:242] 2-packet-sequence-block-to-sender uniform sender id: 5 started [2024-05-06 23:05:34.796233 +08:00] INFO [src/flow_generator/packet_sequence/parser.rs:88] packet sequence parser (id=0) started [2024-05-06 23:05:34.796305 +08:00] INFO [src/flow_generator/protocol_logs/parser.rs:881] app protocol logs parser (id=0) started [2024-05-06 23:05:34.796352 +08:00] INFO [src/flow_generator/protocol_logs/parser.rs:881] app protocol logs parser (id=1) started [2024-05-06 23:05:34.796376 +08:00] INFO [src/collector/quadruple_generator.rs:738] new quadruple_generator id: 0, second_delay: 8, minute_delay: 68, l7_metrics_enabled: true, vtap_flow_1s_enabled: true collector_enabled: true [2024-05-06 23:05:34.797707 +08:00] INFO [src/platform/kubernetes/active_poller.rs:93] kubernetes poller updated to version (1) [2024-05-06 23:05:34.797814 +08:00] INFO [src/collector/quadruple_generator.rs:662] quadruple generator id: 0 started

[2024-05-06 23:05:34.798206 +08:00] INFO [src/collector/flow_aggr.rs:121] l4 flow aggr id: 0 started [2024-05-06 23:05:34.798339 +08:00] INFO [src/collector/collector.rs:1240] second_collector id=(0) started [2024-05-06 23:05:34.798463 +08:00] INFO [src/collector/collector.rs:1240] minute_collector id=(0) started [2024-05-06 23:05:34.798544 +08:00] INFO [src/collector/quadruple_generator.rs:738] new quadruple_generator id: 1, second_delay: 8, minute_delay: 68, l7_metrics_enabled: true, vtap_flow_1s_enabled: true collector_enabled: true [2024-05-06 23:05:34.799833 +08:00] INFO [src/collector/quadruple_generator.rs:662] quadruple generator id: 1 started [2024-05-06 23:05:34.799919 +08:00] INFO [src/collector/collector.rs:1240] second_collector id=(1) started [2024-05-06 23:05:34.800000 +08:00] INFO [src/collector/collector.rs:1240] minute_collector id=(1) started [2024-05-06 23:05:34.800042 +08:00] INFO [src/collector/l7_quadruple_generator.rs:506] new l7 quadruple_generator id: 0, second_delay: 8, minute_delay: 68, l7_metrics_enabled: true, vtap_flow_1s_enabled: true collector_enabled: true [2024-05-06 23:05:34.800289 +08:00] INFO [src/dispatcher/local_mode_dispatcher.rs:63] Start dispatcher (0) [2024-05-06 23:05:34.800544 +08:00] INFO [src/collector/l7_quadruple_generator.rs:448] l7 quadruple generator id: 0 started [2024-05-06 23:05:34.800756 +08:00] INFO [src/collector/collector.rs:1382] second_collector id=(0) started [2024-05-06 23:05:34.800961 +08:00] INFO [src/collector/collector.rs:1382] minute_collector id=(0) started [2024-05-06 23:05:34.801048 +08:00] INFO [src/collector/l7_quadruple_generator.rs:506] new l7 quadruple_generator id: 1, second_delay: 8, minute_delay: 68, l7_metrics_enabled: true, vtap_flow_1s_enabled: true collector_enabled: true [2024-05-06 23:05:34.805716 +08:00] INFO [src/collector/l7_quadruple_generator.rs:448] l7 quadruple generator id: 1 started [2024-05-06 23:05:34.805868 +08:00] INFO [src/collector/collector.rs:1382] second_collector id=(1) started [2024-05-06 23:05:34.805981 +08:00] INFO [src/collector/collector.rs:1382] minute_collector id=(1) started [2024-05-06 23:05:34.806036 +08:00] INFO [src/collector/l7_quadruple_generator.rs:506] new l7 quadruple_generator id: 2, second_delay: 8, minute_delay: 68, l7_metrics_enabled: true, vtap_flow_1s_enabled: true collector_enabled: true [2024-05-06 23:05:34.806451 +08:00] INFO [src/collector/l7_quadruple_generator.rs:448] l7 quadruple generator id: 2 started [2024-05-06 23:05:34.806522 +08:00] INFO [src/collector/collector.rs:1382] second_collector id=(2) started [2024-05-06 23:05:34.806591 +08:00] INFO [src/collector/collector.rs:1382] minute_collector id=(2) started [2024-05-06 23:05:34.806660 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:05:34.834281 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO ctrl_main begin !!! [2024-05-06 23:05:35.835013 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO cpus_kick begin !!! [2024-05-06 23:05:35.926281 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] INFO [eBPF Kernel Adapt] kernel_offset_infer_server close.client_count:2 [2024-05-06 23:05:36.806778 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:05:38.806942 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:05:40.807106 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:05:42.807302 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:05:44.807484 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:05:46.807649 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:05:48.807813 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:05:50.808012 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:05:52.808184 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:05:54.808343 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:05:56.808507 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:05:58.808669 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:00.808839 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:02.809016 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:04.809187 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:06.809357 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:08.809519 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:10.809700 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:12.809863 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:14.810028 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:16.810188 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:18.810367 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:20.810525 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:22.810690 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:24.810841 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:26.811020 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:28.811176 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:30.811333 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:32.811489 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:33.410357 +08:00] INFO [src/rpc/synchronizer.rs:205] Update PlatformData version 0 to 1719014422. [2024-05-06 23:06:33.410488 +08:00] INFO [src/rpc/synchronizer.rs:217] Update IpGroups version 0 to 1715004912. [2024-05-06 23:06:33.410517 +08:00] INFO [src/rpc/synchronizer.rs:227] Update FlowAcls version 0 to 2715005112. [2024-05-06 23:06:33.410534 +08:00] INFO [src/rpc/synchronizer.rs:809] Grpc version ip-groups: 1715004912, interfaces, peer-connections and cidrs: 1719014422, flow-acls: 2715005112 [2024-05-06 23:06:33.411602 +08:00] INFO [src/rpc/synchronizer.rs:826] Grpc finish update cost 1.066317ms on 4 listener, 1 ip-groups, 15 interfaces, 0 peer-connections, 4 cidrs, 0 flow-acls [2024-05-06 23:06:33.440345 +08:00] INFO [src/platform/platform_synchronizer/linux.rs:562] Platform information changed to version 1715007635 [2024-05-06 23:06:33.440393 +08:00] INFO [src/platform/platform_synchronizer/linux.rs:826] local version changed to 1715007635 [2024-05-06 23:06:33.657631 +08:00] INFO [src/flow_generator/flow_map.rs:412] loaded 0 wasm and 0 so plugins [2024-05-06 23:06:34.811644 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:36.069962 +08:00] INFO [src/collector/flow_aggr.rs:315] now slot start time is 1715007932s have flushed minute slot count is 1715007931 [2024-05-06 23:06:36.811801 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:38.811960 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:40.023991 +08:00] INFO [src/sender/uniform_sender.rs:407] 2-protolog-to-collector-sender sender tcp connection to 192.168.13.47:30033 succeed. [2024-05-06 23:06:40.812127 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:42.812293 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:43.016512 +08:00] INFO [src/sender/uniform_sender.rs:407] 3-flowlog-to-collector-sender sender tcp connection to 192.168.13.47:30033 succeed. [2024-05-06 23:06:44.812451 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:46.812624 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:48.812783 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:49.080048 +08:00] INFO [src/sender/uniform_sender.rs:407] 3-doc-to-collector-sender sender tcp connection to 192.168.13.47:30033 succeed. [2024-05-06 23:06:50.812941 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:52.813115 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:54.813282 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:56.813454 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:06:58.813609 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:07:00.813763 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:07:02.813922 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:07:04.814085 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:07:06.814258 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:07:08.814413 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:07:10.814561 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:07:12.814720 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later. [2024-05-06 23:07:14.814867 +08:00] ERROR [src/ebpf_dispatcher/ebpf_dispatcher.rs:613] [eBPF Kernel Adapt] The socket_tracer_start() error. Kernel offset adapt failed. Please ensure that BTF is enabled (kernel built with CONFIG_DEBUG_INFO_BTF=y option). If the current kernel version is low (<5.2), upgrading the Linux kernel to 5.2+ (kernel built with CONFIG_DEBUG_INFO_BTF=y option) can solve the problem. If it is not possible to upgrade the kernel, the kernel-devel package can be provided for developers to adapt and solve the problem. [2024-05-06 23:07:14.814975 +08:00] INFO [src/ebpf/mod.rs:643] [eBPF] WARN func socket_tracer_start() [user/socket.c:2176] [eBPF Kernel Adapt] Adapting the linux kernel(4.14.105-1-tlinux3-0023.1) is in progress, please try the start operation again later.

Are you willing to submit a PR?

Code of Conduct

yinjiping commented 6 months ago

@qyzhaoxun 感谢您的问题 从日志看,eBPF prog 已经加载成功了,但是没有适配内核。 https://github.com/deepflowio/show-kernel-struct-offset 请根据这个,贴一下信息,我们来适配一下。

qyzhaoxun commented 6 months ago

make -C /lib/modules/4.14.105-1-tlinux3-0023.1/build/ M=/root/show-kernel-struct-offset modules

make: 进入目录“/usr/src/kernels/4.14.105-1-tlinux3-0023.1” CC [M] /root/show-kernel-struct-offset/skso.o Building modules, stage 2. MODPOST 1 modules CC /root/show-kernel-struct-offset/skso.mod.o LD [M] /root/show-kernel-struct-offset/skso.ko make: 离开目录“/usr/src/kernels/4.14.105-1-tlinux3-0023.1”

objdump -d skso.ko

skso.ko: 文件格式 elf64-x86-64

Disassembly of section .text:

0000000000000000 : 0: e8 00 00 00 00 callq 5 <STRUCT_TCP_SOCK_COPIED_SEQ_OFFSET+0x5> 5: 55 push %rbp 6: b8 2c 05 00 00 mov $0x52c,%eax b: 48 89 e5 mov %rsp,%rbp e: 5d pop %rbp f: c3 retq

0000000000000010 : 10: e8 00 00 00 00 callq 15 <STRUCT_TCP_SOCK_WRITE_SEQ_OFFSET+0x5> 15: 55 push %rbp 16: b8 7c 06 00 00 mov $0x67c,%eax 1b: 48 89 e5 mov %rsp,%rbp 1e: 5d pop %rbp 1f: c3 retq

0000000000000020 : 20: e8 00 00 00 00 callq 25 <STRUCT_TASK_FILES_OFFSET+0x5> 25: 55 push %rbp 26: b8 d8 0c 00 00 mov $0xcd8,%eax 2b: 48 89 e5 mov %rsp,%rbp 2e: 5d pop %rbp 2f: c3 retq

0000000000000030 : 30: e8 00 00 00 00 callq 35 <STRUCT_SOCK_FLAGS_OFFSET+0x5> 35: 55 push %rbp 36: b8 f8 01 00 00 mov $0x1f8,%eax 3b: 48 89 e5 mov %rsp,%rbp 3e: 5d pop %rbp 3f: c3 retq

0000000000000040 : 40: e8 00 00 00 00 callq 45 <STRUCT_FILES_PRIVATE_DATA_OFFSET+0x5> 45: 55 push %rbp 46: b8 c0 00 00 00 mov $0xc0,%eax 4b: 48 89 e5 mov %rsp,%rbp 4e: 5d pop %rbp 4f: c3 retq

0000000000000050 : 50: e8 00 00 00 00 callq 55 <STRUCT_TASK_TLS_OFFSET+0x5> 55: 55 push %rbp 56: b8 28 24 00 00 mov $0x2428,%eax 5b: 48 89 e5 mov %rsp,%rbp 5e: 5d pop %rbp 5f: c3 retq

0000000000000060 : 60: e8 00 00 00 00 callq 65 <init_module+0x5> 65: 55 push %rbp 66: 31 c0 xor %eax,%eax 68: 48 89 e5 mov %rsp,%rbp 6b: 5d pop %rbp 6c: c3 retq 6d: 0f 1f 00 nopl (%rax)

0000000000000070 : 70: e8 00 00 00 00 callq 75 <cleanup_module+0x5> 75: 55 push %rbp 76: 48 89 e5 mov %rsp,%rbp 79: 5d pop %rbp 7a: c3 retq