search

gleanerio / gleaner

Gleaner: JSON-LD and structured data on the web harvesting
https://gleaner.io
Apache License 2.0
15 stars 10 forks source link

Minio Free Storage limit error #250

Open valentinedwv opened 6 months ago

valentinedwv commented 6 months ago

got an error like this: replication error "Storage backend has reached its minimum free drive threshold" https://github.com/minio/minio/issues/18639

about %10 left on disk (aka 10 gigs on 100gig disk).

When run in container, the process in the schdeuler just hanged (no return value, I assume). Had to look into the actual service log to find the error.

"file":"/home/runner/work/gleaner/gleaner/internal/common/pipecopy.go:59","func":"github.com/gleanerio/gleaner/internal/common.PipeCopyNG.func2","level":"error","msg":"Storage backend has reached its minimum free drive threshold. Please delete a few objects to proceed.","time":"2024-01-10T00:18:24Z"

need to catch, and return a non-zero error.

Probably need to do this in Nabu, also

premax commented 5 months ago

We've got 33T disk and 330G free space. Minio does not accept new objects because "Storage backend has reached its minimum free drive threshold". 1% hard limit is insane. This threshold really should be configurable.

valentinedwv commented 1 month ago

Hit this again... keep the portainer and minio separate ;) clean up the unused docker images

2024-06-16T07:00:16Z ERR | file=/home/runner/work/gleaner/gleaner/internal/common/pipecopy.go:59 func=github.com/gleanerio/gleaner/internal/common.PipeCopyNG.func2 msg=Storage backend has reached its minimum free drive threshold. Please delete a few objects to proceed.