LINBIT / linstor-server

High Performance Software-Defined Block Storage for container, cloud and virtualisation. Fully integrated with Docker, Kubernetes, Openstack, Proxmox etc.
https://docs.linbit.com/docs/linstor-guide/
GNU General Public License v3.0
984 stars 76 forks source link

com.linbit.linstor.storage.StorageException: Failed to write #402

Closed 0sorkon closed 7 months ago

0sorkon commented 7 months ago

Hi There is a constant error in the logs: ERROR LINSTOR/Satellite - SYSTEM - com.linbit.linstor.storage.StorageException: Failed to write '253:124 400' to path /sys/fs/cgroup/blkio/blkio.throttle.read_iops_device [Report number 661E2EF3-AC4FA-000005]

linstor err s 661E2EF3-AC4FA-000005 says:

============================================================

Application:                        LINBIT® LINSTOR
Module:                             Satellite
Version:                            1.25.0
Build ID:                           ac6be8b59c99ae4157b4368df646cf530444d70f
Build time:                         2023-10-25T04:33:26+00:00
Error time:                         2024-04-16 09:55:55
Node:                               node2.net

============================================================

Reported error:
===============

Category:                           Error
Class name:                         ImplementationError
Class canonical name:               com.linbit.ImplementationError
Generated at:                       Method 'updateSysFsSettings', Source file 'SysFsHandler.java', Line #119

Error message:                      com.linbit.linstor.storage.StorageException: Failed to write '253:124 400' to path /sys/fs/cgroup/blkio/blkio.throttle.read_iops_device

Call backtrace:

    Method                                   Native Class:Line number
    updateSysFsSettings                      N      com.linbit.linstor.core.SysFsHandler:119
    processResourcesAndSnapshots             N      com.linbit.linstor.core.devmgr.DeviceHandlerImpl:490
    dispatchResources                        N      com.linbit.linstor.core.devmgr.DeviceHandlerImpl:181
    dispatchResources                        N      com.linbit.linstor.core.devmgr.DeviceManagerImpl:328
    phaseDispatchDeviceHandlers              N      com.linbit.linstor.core.devmgr.DeviceManagerImpl:1156
    devMgrLoop                               N      com.linbit.linstor.core.devmgr.DeviceManagerImpl:756
    run                                      N      com.linbit.linstor.core.devmgr.DeviceManagerImpl:650
    run                                      N      java.lang.Thread:829

Caused by:
==========

Description:
    Failed to write '253:124 400' to path /sys/fs/cgroup/blkio/blkio.throttle.read_iops_device

Category:                           LinStorException
Class name:                         StorageException
Class canonical name:               com.linbit.linstor.storage.StorageException
Generated at:                       Method 'setSysFs', Source file 'SysFsHandler.java', Line #377

Error message:                      Failed to write '253:124 400' to path /sys/fs/cgroup/blkio/blkio.throttle.read_iops_device

ErrorContext:

Call backtrace:

    Method                                   Native Class:Line number
    setSysFs                                 N      com.linbit.linstor.core.SysFsHandler:377
    setThrottle                              N      com.linbit.linstor.core.SysFsHandler:317
    lambda$updateCgroupBlkioThrottleReadIopsDevice$2 N      com.linbit.linstor.core.SysFsHandler:187
    lambda$execForAllLowestLocalVlmData$3    N      com.linbit.linstor.core.SysFsHandler:248
    execForAllVlmData                        N      com.linbit.linstor.core.SysFsHandler:357
    execForAllVlmData                        N      com.linbit.linstor.core.SysFsHandler:363
    execForAllLowestLocalVlmData             N      com.linbit.linstor.core.SysFsHandler:213
    updateCgroupBlkioThrottleReadIopsDevice  N      com.linbit.linstor.core.SysFsHandler:185
    updateSysFsSettings                      N      com.linbit.linstor.core.SysFsHandler:114
    processResourcesAndSnapshots             N      com.linbit.linstor.core.devmgr.DeviceHandlerImpl:490
    dispatchResources                        N      com.linbit.linstor.core.devmgr.DeviceHandlerImpl:181
    dispatchResources                        N      com.linbit.linstor.core.devmgr.DeviceManagerImpl:328
    phaseDispatchDeviceHandlers              N      com.linbit.linstor.core.devmgr.DeviceManagerImpl:1156
    devMgrLoop                               N      com.linbit.linstor.core.devmgr.DeviceManagerImpl:756
    run                                      N      com.linbit.linstor.core.devmgr.DeviceManagerImpl:650
    run                                      N      java.lang.Thread:829

END OF ERROR REPORT.

what could it be and how do I fix it?

rp- commented 7 months ago

This is because of missing cgroupv1, but it was "fixed" in 1.27.0