LINBIT / linstor-server

High Performance Software-Defined Block Storage for container, cloud and virtualisation. Fully integrated with Docker, Kubernetes, Openstack, Proxmox etc.
https://docs.linbit.com/docs/linstor-guide/
GNU General Public License v3.0
984 stars 76 forks source link

Linstor controller v1.25.1 does not start in the Kubernetes cluster due to a LinStorDBRuntimeException + NullPointerException exception #386

Open dmrub opened 9 months ago

dmrub commented 9 months ago

I believe that this issue is related to the https://github.com/LINBIT/linstor-server/issues/384 problem. I have just tested the latest version of priaeus-operator and after several tests I get a similar problem:

When starting in a cluster linstor controller stops with following error:

10:03:44.629 [Main] INFO  LINSTOR/Controller - SYSTEM - Security objects load from database is in progress
com.linbit.linstor.LinStorDBRuntimeException: Database entry of table SEC_OBJECT_PROTECTION could not be restored.
        at com.linbit.linstor.dbdrivers.k8s.crd.K8sCrdEngine.loadAll(K8sCrdEngine.java:266)
        at com.linbit.linstor.dbdrivers.AbsDatabaseDriver.loadAll(AbsDatabaseDriver.java:170)
        at com.linbit.linstor.security.SecDatabaseLoader.loadAll(SecDatabaseLoader.java:123)
        at com.linbit.linstor.dbdrivers.DatabaseLoader.loadSecurityObjects(DatabaseLoader.java:307)
        at com.linbit.linstor.core.DbDataInitializer.loadCoreObjects(DbDataInitializer.java:160)
        at com.linbit.linstor.core.DbDataInitializer.initialize(DbDataInitializer.java:101)
        at com.linbit.linstor.core.ApplicationLifecycleManager.startSystemServices(ApplicationLifecycleManager.java:87)
        at com.linbit.linstor.core.Controller.start(Controller.java:361)
        at com.linbit.linstor.core.Controller.main(Controller.java:609)
Caused by: java.lang.NullPointerException: Tried to load object protection (/sys/controller/remoteMap) with missing creator identity: SYSTEM
        at java.base/java.util.Objects.requireNonNull(Objects.java:246)
        at com.linbit.linstor.security.SecObjectProtectionDbDriver.load(SecObjectProtectionDbDriver.java:142)
        at com.linbit.linstor.security.SecObjectProtectionDbDriver.load(SecObjectProtectionDbDriver.java:35)
        at com.linbit.linstor.dbdrivers.k8s.crd.K8sCrdEngine.loadAll(K8sCrdEngine.java:237)
        ... 8 more
ErrorContext: 
ErrorContext:   Details:     Primary key: OBJECT_PATH = '/sys/controller/remoteMap'

linstor-controller-error-log-2024-02-05T110338.txt ErrorReport-65C0B27C-00000-000000.log ErrorReport-65C0B27C-00000-000001.log linstor-Controller.log