eip-work / kuboard-press

Kuboard 是基于 Kubernetes 的微服务管理界面。同时提供 Kubernetes 免费中文教程,入门教程,最新版本的 Kubernetes v1.23.4 安装手册,(k8s install) 在线答疑,持续更新。
https://kuboard.cn/
22.27k stars 1.51k forks source link

资源层监控套件安装失败,prometheus-k8s pod启动报错:unexpected fault address 0x7f83809c7000 #416

Open kongzi68 opened 1 year ago

kongzi68 commented 1 year ago

Kubernetes gitVersion:v1.23.6+rke2r2 Kubernetes buildDate:2022-04-29 03:13:01 Kubernetes platform:linux/amd64

image

资源层监控套件 安装失败 image image

pod 中容器 prometheus 日志报错详情:

level=info ts=2023-06-02T07:57:00.641Z caller=main.go:428 msg="Starting Prometheus" version="(version=2.29.1, branch=HEAD, revision=dcb07e8eac34b5ea37cd229545000b857f1c1637)"
level=info ts=2023-06-02T07:57:00.641Z caller=main.go:433 build_context="(go=go1.16.7, user=root@364730518a4e, date=20210811-14:48:27)"
level=info ts=2023-06-02T07:57:00.641Z caller=main.go:434 host_details="(Linux 5.4.0-144-generic #161-Ubuntu SMP Fri Feb 3 14:49:04 UTC 2023 x86_64 prometheus-k8s-0 (none))"
level=info ts=2023-06-02T07:57:00.641Z caller=main.go:435 fd_limits="(soft=1048576, hard=1048576)"
level=info ts=2023-06-02T07:57:00.641Z caller=main.go:436 vm_limits="(soft=unlimited, hard=unlimited)"
unexpected fault address 0x7f83809c7000
fatal error: fault
[signal SIGBUS: bus error code=0x2 addr=0x7f83809c7000 pc=0x472ec8]
goroutine 1 [running]:
runtime.throw(0x3077f55, 0x5)
        /usr/local/go/src/runtime/panic.go:1117 +0x72 fp=0xc00098f1a0 sp=0xc00098f170 pc=0x438292
runtime.sigpanic()
        /usr/local/go/src/runtime/signal_unix.go:731 +0x2c8 fp=0xc00098f1d8 sp=0xc00098f1a0 pc=0x44fb48
runtime.memmove(0x7f83809c7000, 0x384ce20, 0x1)
        /usr/local/go/src/runtime/memmove_amd64.s:148 +0x108 fp=0xc00098f1e0 sp=0xc00098f1d8 pc=0x472ec8
github.com/prometheus/prometheus/promql.NewActiveQueryTracker(0x7ffd46169d13, 0xb, 0x14, 0x38c3420, 0xc0007955e0, 0x38c3420)
        /app/promql/query_logger.go:120 +0x3b8 fp=0xc00098f348 sp=0xc00098f1e0 pc=0x2559078
main.main()
        /app/cmd/prometheus/main.go:464 +0x57d0 fp=0xc00098ff88 sp=0xc00098f348 pc=0x266a9b0
runtime.main()
        /usr/local/go/src/runtime/proc.go:225 +0x256 fp=0xc00098ffe0 sp=0xc00098ff88 pc=0x43aad6
runtime.goexit()
        /usr/local/go/src/runtime/asm_amd64.s:1371 +0x1 fp=0xc00098ffe8 sp=0xc00098ffe0 pc=0x471fc1
goroutine 15 [select]:
go.opencensus.io/stats/view.(*worker).start(0xc000128080)
        /go/pkg/mod/go.opencensus.io@v0.23.0/stats/view/worker.go:276 +0xcd
created by go.opencensus.io/stats/view.init.0
        /go/pkg/mod/go.opencensus.io@v0.23.0/stats/view/worker.go:34 +0x68
goroutine 95 [select]:
github.com/prometheus/prometheus/pkg/logging.(*Deduper).run(0xc000cb0f00)
        /app/pkg/logging/dedupe.go:75 +0x1c5
created by github.com/prometheus/prometheus/pkg/logging.Dedupe
        /app/pkg/logging/dedupe.go:61 +0xcf
goroutine 166 [chan receive]:
github.com/prometheus/prometheus/storage/remote.(*WriteStorage).run(0xc00004dae0)
        /app/storage/remote/write.go:103 +0xb6
created by github.com/prometheus/prometheus/storage/remote.NewWriteStorage
        /app/storage/remote/write.go:96 +0x30e