konpyutaika / nifikop

The NiFiKop NiFi Kubernetes operator makes it easy to run Apache NiFi on Kubernetes. Apache NiFI is a free, open-source solution that support powerful and scalable directed graphs of data routing, transformation, and system mediation logic.
https://konpyutaika.github.io/nifikop/
Apache License 2.0
122 stars 40 forks source link

Not able to spin nificluster using helm chart not Basic nificluster configuration Giving nil pointer error #376

Closed api-creds closed 5 months ago

api-creds commented 5 months ago

What steps will reproduce the bug?

Applied config from https://konpyutaika.github.io/nifikop/docs/5_references/1_nifi_cluster/

Getting this error in Nifikop pod

[Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: {"level":"info","time":"2024-01-25T07:04:34.084Z","caller":"controller/controller.go:118","msg":"Observed a panic in reconciler: runtime error: invalid memory address or nil pointer dereference","controller":"nificluster","controllerGroup":"nifi.konpyutaika.com","controllerKind":"NifiCluster","nifiCluster":{"name":"simplenifi","namespace":"nifi-stage"},"namespace":"nifi-stage","name":"simplenifi","reconcileID":"cce2ce62-5814-4a1e-b4fd-0a0d1895c4e5"} [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: panic: runtime error: invalid memory address or nil pointer dereference [recovered] [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: panic: runtime error: invalid memory address or nil pointer dereference [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: [signal SIGSEGV: segmentation violation code=0x1 addr=0x20 pc=0x10c3aa0] [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: goroutine 392 [running]: [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: sigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).Reconcile.func1() [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.6/pkg/internal/controller/controller.go:119 +0x1a4 [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: panic({0x12adfe0?, 0x23a7090?}) [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: /usr/local/go/src/runtime/panic.go:914 +0x218 [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: github.com/konpyutaika/nifikop/pkg/resources/nifi.(Reconciler).Reconcile(0x4000a11dd0, {{0x17874c8, 0x40000a5830}, 0x0, 0x1, {0x0, 0x0}, {0x4000028ba0, 0x17}, {0x17736e0, ...}, ...}) [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: /workspace/pkg/resources/nifi/nifi.go:165 +0x1f60 [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: github.com/konpyutaika/nifikop/controllers.(NifiClusterReconciler).Reconcile(0x40000928f0, {0x1786c00, 0x4000719d70}, {{{0x4000477a30?, 0x30?}, {0x4000477a06?, 0xffff44e08101?}}}) [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: /workspace/controllers/nificluster_controller.go:146 +0xd80 [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: sigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).Reconcile(0x1786c00?, {0x1786c00?, 0x4000719d70?}, {{{0x4000477a30?, 0x11fb7e0?}, {0x4000477a06?, 0x0?}}}) [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.6/pkg/internal/controller/controller.go:122 +0x8c [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: sigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).reconcileHandler(0x4000426000, {0x1786c38, 0x4000101e50}, {0x1318520?, 0x400042ebe0?}) [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.6/pkg/internal/controller/controller.go:323 +0x294 [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: sigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).processNextWorkItem(0x4000426000, {0x1786c38, 0x4000101e50}) [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.6/pkg/internal/controller/controller.go:274 +0x198 [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: sigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).Start.func2.2() [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.6/pkg/internal/controller/controller.go:235 +0x74 [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: created by sigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).Start.func2 in goroutine 101 [Jan 25 2024 12:34:34 GMT+0530] nifikop-stage-77b7499d9f-ljfwb: /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.14.6/pkg/internal/controller/controller.go:231 +0x43c

and nifikop also failing

What is the expected behavior?

It should spin 2 nodes with default_group config

What do you see instead?

Error in nifikop pod, No Node has come up.

Possible solution

No response

NiFiKop version

v1.6

Golang version

1.19

Kubernetes version

1.27K8s version

NiFi version

1.16

Additional context

No response

mh013370 commented 5 months ago

Thanks for raising this issue. We maintain this sample and it does work: https://github.com/konpyutaika/nifikop/blob/master/config/samples/simplenificluster.yaml

But we will fix the documentation under this issue. Thanks again!