search

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
29.87k stars 3.77k forks source link

Sentry: panic.go:770: runtime error: invalid memory address or nil pointer dereference (1) attached stack trace -- stack trace: | runtime.gopanic | GOROOT/src/runtime/panic.go:770 | runtime.p... #129305

Open cockroach-sentry opened 3 weeks ago

cockroach-sentry commented 3 weeks ago

This issue was auto filed by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry Link: https://cockroach-labs.sentry.io/issues/5733899428/?referrer=webhooks_plugin

Panic Message:

panic.go:770: runtime error: invalid memory address or nil pointer dereference
(1) attached stack trace
  -- stack trace:
  | runtime.gopanic
  |     GOROOT/src/runtime/panic.go:770
  | runtime.panicmem
  |     GOROOT/src/runtime/panic.go:261
  | runtime.sigpanic
  |     GOROOT/src/runtime/signal_unix.go:881
  | github.com/cockroachdb/cockroach/pkg/ccl/backupccl.(*backupDataProcessor).close
  |     github.com/cockroachdb/cockroach/pkg/ccl/backupccl/backup_processor.go:291
  | github.com/cockroachdb/cockroach/pkg/ccl/backupccl.(*backupDataProcessor).ConsumerClosed
  |     github.com/cockroachdb/cockroach/pkg/ccl/backupccl/backup_processor.go:301
  | github.com/cockroachdb/cockroach/pkg/sql/flowinfra.(*FlowBase).Cleanup
  |     github.com/cockroachdb/cockroach/pkg/sql/flowinfra/flow.go:684
  | github.com/cockroachdb/cockroach/pkg/sql/rowflow.(*rowBasedFlow).Cleanup
  |     github.com/cockroachdb/cockroach/pkg/sql/rowflow/row_based_flow.go:499
  | github.com/cockroachdb/cockroach/pkg/sql/distsql.(*ServerImpl).SetupFlow.func1
  |     github.com/cockroachdb/cockroach/pkg/sql/distsql/server.go:653
  | github.com/cockroachdb/cockroach/pkg/sql/distsql.(*ServerImpl).SetupFlow
  |     github.com/cockroachdb/cockroach/pkg/sql/distsql/server.go:667
  | github.com/cockroachdb/cockroach/pkg/sql/execinfrapb._DistSQL_SetupFlow_Handler.func1
  |     github.com/cockroachdb/cockroach/pkg/sql/execinfrapb/bazel-out/k8-opt/bin/pkg/sql/execinfrapb/execinfrapb_go_proto_/github.com/cockroachdb/cockroach/pkg/sql/execinfrapb/api.pb.go:597
  | github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.ServerInterceptor.func12
  |     github.com/cockroachdb/cockroach/pkg/util/tracing/grpcinterceptor/grpc_interceptor.go:97
  | google.golang.org/grpc.getChainUnaryHandler.func1
  |     google.golang.org/grpc/external/org_golang_google_grpc/server.go:1154
  | github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func3
  |     github.com/cockroachdb/cockroach/pkg/rpc/pkg/rpc/context.go:169
  | google.golang.org/grpc.getChainUnaryHandler.func1
  |     google.golang.org/grpc/external/org_golang_google_grpc/server.go:1154
  | github.com/cockroachdb/cockroach/pkg/rpc.kvAuth.unaryInterceptor
  |     github.com/cockroachdb/cockroach/pkg/rpc/pkg/rpc/auth.go:95
  | google.golang.org/grpc.getChainUnaryHandler.func1
  |     google.golang.org/grpc/external/org_golang_google_grpc/server.go:1154
  | github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func1.1
  |     github.com/cockroachdb/cockroach/pkg/rpc/pkg/rpc/context.go:136
  | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
  |     github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:337
  | github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func1
  |     github.com/cockroachdb/cockroach/pkg/rpc/pkg/rpc/context.go:134
  | google.golang.org/grpc.NewServer.chainUnaryServerInterceptors.chainUnaryInterceptors.func1
  |     google.golang.org/grpc/external/org_golang_google_grpc/server.go:1145
  | github.com/cockroachdb/cockroach/pkg/sql/execinfrapb._DistSQL_SetupFlow_Handler
  |     github.com/cockroachdb/cockroach/pkg/sql/execinfrapb/bazel-out/k8-opt/bin/pkg/sql/execinfrapb/execinfrapb_go_proto_/github.com/cockroachdb/cockroach/pkg/sql/execinfrapb/api.pb.go:599
  | google.golang.org/grpc.(*Server).processUnaryRPC
  |     google.golang.org/grpc/external/org_golang_google_grpc/server.go:1335
  | google.golang.org/grpc.(*Server).handleStream
  |     google.golang.org/grpc/external/org_golang_google_grpc/server.go:1712
  | google.golang.org/grpc.(*Server).serveStreams.func1.1
  |     google.golang.org/grpc/external/org_golang_google_grpc/server.go:947
  | runtime.goexit
  |     src/runtime/asm_amd64.s:1695
Wraps: (2) runtime error: invalid memory address or nil pointer dereference
Error types: (1) *withstack.withStack (2) runtime.errorString
-- report composition:
runtime.errorString
panic.go:770: *withstack.withStack (top exception)
Stacktrace (expand for inline code snippets): [src/runtime/asm_amd64.s#L1694-L1696](src/runtime/asm_amd64.s#L1694-L1696) [google.golang.org/grpc/external/org_golang_google_grpc/server.go#L946-L948](google.golang.org/grpc/external/org_golang_google_grpc/server.go#L946-L948) [google.golang.org/grpc/external/org_golang_google_grpc/server.go#L1711-L1713](google.golang.org/grpc/external/org_golang_google_grpc/server.go#L1711-L1713) [google.golang.org/grpc/external/org_golang_google_grpc/server.go#L1334-L1336](google.golang.org/grpc/external/org_golang_google_grpc/server.go#L1334-L1336) [https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/sql/execinfrapb/bazel-out/k8-opt/bin/pkg/sql/execinfrapb/execinfrapb_go_proto_/github.com/cockroachdb/cockroach/pkg/sql/execinfrapb/api.pb.go#L598-L600](https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/sql/execinfrapb/bazel-out/k8-opt/bin/pkg/sql/execinfrapb/execinfrapb_go_proto_/github.com/cockroachdb/cockroach/pkg/sql/execinfrapb/api.pb.go#L598-L600) [google.golang.org/grpc/external/org_golang_google_grpc/server.go#L1144-L1146](google.golang.org/grpc/external/org_golang_google_grpc/server.go#L1144-L1146) [https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/rpc/pkg/rpc/context.go#L133-L135](https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/rpc/pkg/rpc/context.go#L133-L135) [https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/util/stop/stopper.go#L336-L338](https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/util/stop/stopper.go#L336-L338) [https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/rpc/pkg/rpc/context.go#L135-L137](https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/rpc/pkg/rpc/context.go#L135-L137) [google.golang.org/grpc/external/org_golang_google_grpc/server.go#L1153-L1155](google.golang.org/grpc/external/org_golang_google_grpc/server.go#L1153-L1155) [https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/rpc/pkg/rpc/auth.go#L94-L96](https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/rpc/pkg/rpc/auth.go#L94-L96) [google.golang.org/grpc/external/org_golang_google_grpc/server.go#L1153-L1155](google.golang.org/grpc/external/org_golang_google_grpc/server.go#L1153-L1155) [https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/rpc/pkg/rpc/context.go#L168-L170](https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/rpc/pkg/rpc/context.go#L168-L170) [google.golang.org/grpc/external/org_golang_google_grpc/server.go#L1153-L1155](google.golang.org/grpc/external/org_golang_google_grpc/server.go#L1153-L1155) [https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/util/tracing/grpcinterceptor/grpc_interceptor.go#L96-L98](https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/util/tracing/grpcinterceptor/grpc_interceptor.go#L96-L98) [https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/sql/execinfrapb/bazel-out/k8-opt/bin/pkg/sql/execinfrapb/execinfrapb_go_proto_/github.com/cockroachdb/cockroach/pkg/sql/execinfrapb/api.pb.go#L596-L598](https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/sql/execinfrapb/bazel-out/k8-opt/bin/pkg/sql/execinfrapb/execinfrapb_go_proto_/github.com/cockroachdb/cockroach/pkg/sql/execinfrapb/api.pb.go#L596-L598) [https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/sql/distsql/server.go#L666-L668](https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/sql/distsql/server.go#L666-L668) [https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/sql/distsql/server.go#L652-L654](https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/sql/distsql/server.go#L652-L654) [https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/sql/rowflow/row_based_flow.go#L498-L500](https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/sql/rowflow/row_based_flow.go#L498-L500) [https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/sql/flowinfra/flow.go#L683-L685](https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/sql/flowinfra/flow.go#L683-L685) [https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/ccl/backupccl/backup_processor.go#L300-L302](https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/ccl/backupccl/backup_processor.go#L300-L302) [https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/ccl/backupccl/backup_processor.go#L290-L292](https://github.com/cockroachdb/cockroach/blob/4483498612573da6df27124a0b39dc66a285114d/pkg/ccl/backupccl/backup_processor.go#L290-L292) [GOROOT/src/runtime/signal_unix.go#L880-L882](GOROOT/src/runtime/signal_unix.go#L880-L882) [GOROOT/src/runtime/panic.go#L260-L262](GOROOT/src/runtime/panic.go#L260-L262) [GOROOT/src/runtime/panic.go#L769-L771](GOROOT/src/runtime/panic.go#L769-L771) 
src/runtime/asm_amd64.s in runtime.goexit at line 1695
google.golang.org/grpc/external/org_golang_google_grpc/server.go in google.golang.org/grpc.(*Server).serveStreams.func1.1 at line 947
google.golang.org/grpc/external/org_golang_google_grpc/server.go in google.golang.org/grpc.(*Server).handleStream at line 1712
google.golang.org/grpc/external/org_golang_google_grpc/server.go in google.golang.org/grpc.(*Server).processUnaryRPC at line 1335
pkg/sql/execinfrapb/bazel-out/k8-opt/bin/pkg/sql/execinfrapb/execinfrapb_go_proto_/github.com/cockroachdb/cockroach/pkg/sql/execinfrapb/api.pb.go in pkg/sql/execinfrapb._DistSQL_SetupFlow_Handler at line 599
google.golang.org/grpc/external/org_golang_google_grpc/server.go in google.golang.org/grpc.NewServer.chainUnaryServerInterceptors.chainUnaryInterceptors.func1 at line 1145
pkg/rpc/pkg/rpc/context.go in pkg/rpc.NewServerEx.func1 at line 134
pkg/util/stop/stopper.go in pkg/util/stop.(*Stopper).RunTaskWithErr at line 337
pkg/rpc/pkg/rpc/context.go in pkg/rpc.NewServerEx.func1.1 at line 136
google.golang.org/grpc/external/org_golang_google_grpc/server.go in google.golang.org/grpc.getChainUnaryHandler.func1 at line 1154
pkg/rpc/pkg/rpc/auth.go in pkg/rpc.kvAuth.unaryInterceptor at line 95
google.golang.org/grpc/external/org_golang_google_grpc/server.go in google.golang.org/grpc.getChainUnaryHandler.func1 at line 1154
pkg/rpc/pkg/rpc/context.go in pkg/rpc.NewServerEx.func3 at line 169
google.golang.org/grpc/external/org_golang_google_grpc/server.go in google.golang.org/grpc.getChainUnaryHandler.func1 at line 1154
pkg/util/tracing/grpcinterceptor/grpc_interceptor.go in pkg/rpc.NewServerEx.ServerInterceptor.func12 at line 97
pkg/sql/execinfrapb/bazel-out/k8-opt/bin/pkg/sql/execinfrapb/execinfrapb_go_proto_/github.com/cockroachdb/cockroach/pkg/sql/execinfrapb/api.pb.go in pkg/sql/execinfrapb._DistSQL_SetupFlow_Handler.func1 at line 597
pkg/sql/distsql/server.go in pkg/sql/distsql.(*ServerImpl).SetupFlow at line 667
pkg/sql/distsql/server.go in pkg/sql/distsql.(*ServerImpl).SetupFlow.func1 at line 653
pkg/sql/rowflow/row_based_flow.go in pkg/sql/rowflow.(*rowBasedFlow).Cleanup at line 499
pkg/sql/flowinfra/flow.go in pkg/sql/flowinfra.(*FlowBase).Cleanup at line 684
pkg/ccl/backupccl/backup_processor.go in pkg/ccl/backupccl.(*backupDataProcessor).ConsumerClosed at line 301
pkg/ccl/backupccl/backup_processor.go in pkg/ccl/backupccl.(*backupDataProcessor).close at line 291
GOROOT/src/runtime/signal_unix.go in runtime.sigpanic at line 881
GOROOT/src/runtime/panic.go in runtime.panicmem at line 261
GOROOT/src/runtime/panic.go in runtime.gopanic at line 770

Tags

Tag Value
Command server
Environment v24.2.0-beta.1
Go Version go1.22.5 X:nocoverageredesign
Platform linux amd64
Distribution CCL
Cockroach Release v24.2.0-beta.1
Cockroach SHA 4483498612573da6df27124a0b39dc66a285114d
# of CPUs 2
# of Goroutines 430

Jira issue: CRDB-41485

blathers-crl[bot] commented 3 weeks ago

Hi @cockroach-sentry, please add branch-* labels to identify which branch(es) this C-bug affects.

:owl: Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.