search

oceanbase / oblogproxy

A proxy service of incremental log of OceanBase
Other
41 stars 19 forks source link

[Question]: 可以打包成deb包吗 #55

Open Leonz3n opened 1 month ago

Leonz3n commented 1 month ago

Description

OB版本: 4.3.0 OBLogProxy版本: 2.0.1_BP2 OBLogClient版本: 1.1.2

打包成Docker镜像，宿主机是 Ubuntu 22.04 的情况下，在Docker或者Kubernetes中会出现一下错误

[2024-05-17 12:56:50] [info] mysql_protocol.cpp(49): Connect to server success:xxxx user: root@sys
[2024-05-17 12:56:50] [info] mysql_protocol.cpp(120): Auth user success of server: xxxx, user: root@sys
[2024-05-17 12:56:50] [info] mysql_protocol.cpp(211): Query obmysql SQL:show tenant
[2024-05-17 12:56:50] [info] mysql_protocol.cpp(49): Connect to server success: xxxxxx, user: root
[2024-05-17 12:56:50] [info] mysql_protocol.cpp(120): Auth user success of server: xxxxx, user: root
[2024-05-17 12:56:50] [info] mysql_protocol.cpp(211): Query obmysql SQL:SELECT svr_min_log_timestamp FROM oceanbase.__all_virtual_server_clog_stat WHERE zone_status='ACTIVE';
[2024-05-17 12:56:50] [error] mysql_protocol.cpp(236): Failed to query observer:Table 'oceanbase.__all_virtual_server_clog_stat' doesn't exist
[2024-05-17 12:56:50] [error] clog_meta_routine.cpp(52): Failed to check the existence of svr_min_log_timestamp column in __all_virtual_server_clog_stat, disable clog check
[2024-05-17 12:56:50] [info] arranger.cpp(215): Client connecting: type:0, id:xxxxxx_68619_1715950610, ip:xxxxxxxxx, version:1.1.2, configuration:tb_white_list=sys.test* cluster_user=root@sys timezone=Asia/Shanghai rootserver_list=xxxxxxxxx:30882:30881 cluster_password=xxxxxxxxxx cluster_id= sys_user=root tb_black_list=| working_mode=storage first_start_timestamp_us=0 first_start_timestamp=0 sys_password=xxxxxxx , pid:0, peer:fd:8, register_time:1715950610, enable_monitor:0, packet_version:2, 
[2024-05-17 12:56:50] [info] source_invoke.cpp(58): +++ Created oblogreader with pid: 835
[2024-05-17 12:56:50] [info] arranger.cpp(233): Remove peer: id:72325919695503368, fd:8, addr:16839690, port:28545 after source invoked, current channel count:0
[2024-05-17 12:56:50] [info] arranger.cpp(238): Client connected: xxxxxx_68619_1715950610 with peer: id:72325919695503368, fd:8, addr:16839690, port:28545
[2024-05-17 12:56:50] [warning] comm.cpp(72): >>> Communicator disabled listening, fd: 7
[2024-05-17 12:56:50] [info] comm.cpp(63): Communicator stopping
[2024-05-17 12:56:50] [info] comm.cpp(65): Communicator stopped
[2024-05-17 12:56:59] [info] status_thread.cpp(44): COUNTS:[NREADER:3][NCHANNEL:0]
[2024-05-17 12:56:59] [error] fs_util.cpp(291): Failed to open: /sys/fs/cgroup/cpuacct/cpuacct.usage_percpu errno:2
[2024-05-17 12:56:59] [error] sys_metric.cpp(48): Failed to get cpu core count for failed to read: /sys/fs/cgroup/cpuacct/cpuacct.usage_percpu
[2024-05-17 12:56:59] [error] sys_metric.cpp(172): Failed to collect cpu for failed to get_cpu_core_count
[2024-05-17 12:56:59] [error] status_thread.cpp(48): Failed to collect metric
[2024-05-17 12:57:09] [info] status_thread.cpp(44): COUNTS:[NREADER:3][NCHANNEL:0]
[2024-05-17 12:57:09] [error] fs_util.cpp(291): Failed to open: /sys/fs/cgroup/cpuacct/cpuacct.usage_percpu errno:2
[2024-05-17 12:57:09] [error] sys_metric.cpp(48): Failed to get cpu core count for failed to read: /sys/fs/cgroup/cpuacct/cpuacct.usage_percpu
[2024-05-17 12:57:09] [error] sys_metric.cpp(172): Failed to collect cpu for failed to get_cpu_core_count
[2024-05-17 12:57:09] [error] status_thread.cpp(48): Failed to collect metric
[2024-05-17 12:57:19] [info] status_thread.cpp(44): COUNTS:[NREADER:3][NCHANNEL:0]
[2024-05-17 12:57:19] [error] fs_util.cpp(291): Failed to open: /sys/fs/cgroup/cpuacct/cpuacct.usage_percpu errno:2
[2024-05-17 12:57:19] [error] sys_metric.cpp(48): Failed to get cpu core count for failed to read: /sys/fs/cgroup/cpuacct/cpuacct.usage_percpu
[2024-05-17 12:57:19] [error] sys_metric.cpp(172): Failed to collect cpu for failed to get_cpu_core_count
[2024-05-17 12:57:19] [error] status_thread.cpp(48): Failed to collect metric

OBLogClient显示连接成功但未收到任何LogMessage

namewxt1220 commented 1 month ago

未收到 LogMessage 需要看一下，oblogreader 进程所在目录的日志，看下 run/{client id} 这个目录

Leonz3n commented 1 month ago

@namewxt1220 get_cpu_core_count 这个调用报错应该是没啥影响？宿主机是 ubuntu 的情况下，containerd 里确实没有 /sys/fs/cgroup/cpuacct/cpuacct.usage_percpu

oblogreader.log

[2024-05-20 04:17:59] [info] reader_routine.cpp(85): Fetch liboblog timeout, nothing incoming...
[2024-05-20 04:18:01] [info] sender_routine.cpp(110): Send transfer queue empty, retry...
[2024-05-20 04:18:01] [info] counter.cpp(67): Counter:[Span:2000ms][Delay:0,0][RCNT:0][RRPS:0][RIOS:0][WCNT:0][WRPS:0][WIOS:0,AVG:0][XWIOS:0,AVG:0][RFETCH:0][ROFFER:0][SPOLL:0][SENCODE:0][SSEND:0][BINLOG_DELAY_US:0][NRecordQ:0]
[2024-05-20 04:18:01] [info] reader_routine.cpp(85): Fetch liboblog timeout, nothing incoming...
[2024-05-20 04:18:03] [info] sender_routine.cpp(110): Send transfer queue empty, retry...
[2024-05-20 04:18:03] [info] counter.cpp(67): Counter:[Span:2000ms][Delay:0,0][RCNT:0][RRPS:0][RIOS:0][WCNT:0][WRPS:0][WIOS:0,AVG:0][XWIOS:0,AVG:0][RFETCH:0][ROFFER:0][SPOLL:0][SENCODE:0][SSEND:0][BINLOG_DELAY_US:0][NRecordQ:0]
[2024-05-20 04:18:03] [info] reader_routine.cpp(85): Fetch liboblog timeout, nothing incoming...
[2024-05-20 04:18:05] [info] sender_routine.cpp(110): Send transfer queue empty, retry...
[2024-05-20 04:18:05] [info] counter.cpp(67): Counter:[Span:2000ms][Delay:0,0][RCNT:0][RRPS:0][RIOS:0][WCNT:0][WRPS:0][WIOS:0,AVG:0][XWIOS:0,AVG:0][RFETCH:0][ROFFER:0][SPOLL:0][SENCODE:0][SSEND:0][BINLOG_DELAY_US:0][NRecordQ:0]
[2024-05-20 04:18:05] [info] reader_routine.cpp(85): Fetch liboblog timeout, nothing incoming...
[2024-05-20 04:18:07] [info] sender_routine.cpp(110): Send transfer queue empty, retry...
[2024-05-20 04:18:07] [info] counter.cpp(67): Counter:[Span:2000ms][Delay:0,0][RCNT:0][RRPS:0][RIOS:0][WCNT:0][WRPS:0][WIOS:0,AVG:0][XWIOS:0,AVG:0][RFETCH:0][ROFFER:0][SPOLL:0][SENCODE:0][SSEND:0][BINLOG_DELAY_US:0][NRecordQ:0]
[2024-05-20 04:18:07] [info] reader_routine.cpp(85): Fetch liboblog timeout, nothing incoming...

init.log

sys_password:xxxx,
sys_user:root,
tb_white_list:*.*.*,
tenant:,
tb_black_list:|,
timezone:Asia/Shanghai,
working_mode:storage,

[2024-05-20 04:10:55.669] [init] [info] [oblogreader_entry.cpp:107] Parsed ClientMeta: type:0, id:192.168.2.108_34698_1716178254, ip:192.168.2.108, version:1.1.2, configuration:tb_white_list=*.*.* cluster_user=root@sys timezone=Asia/Shanghai rootserver_list=xxxxxx:30882:30881 cluster_password=E33492042C6F27D7F097F669A50F591728D14DEE cluster_id= sys_user=root tb_black_list=| working_mode=storage first_start_timestamp_us=0 first_start_timestamp=0 sys_password=xxxxx , pid:0, peer:fd:8, register_time:1716178255, enable_monitor:0, packet_version:2,
namewxt1220 commented 1 month ago

是的，get_cpu_core_count 这个报错可以暂时忽略，看 oblogreader.log 是没有从 ob 成功拉取日志，麻烦发一下 libobcdc 日志

Leonz3n commented 1 month ago

@namewxt1220 文件有点大，给出下载地址 https://shipber-public-files.oss-cn-fuzhou.aliyuncs.com/202405141/libobcdc.log