grafana / loki

Like Prometheus, but for logs.
https://grafana.com/loki
GNU Affero General Public License v3.0
23.58k stars 3.41k forks source link

compactor failed #14448

Open Nello-Angelo opened 1 day ago

Nello-Angelo commented 1 day ago

Describe the bug

mkdir : no such file or directory
error initialising module: compactor
github.com/grafana/dskit/modules.(*Manager).initModule
    /src/loki/vendor/github.com/grafana/dskit/modules/modules.go:138
github.com/grafana/dskit/modules.(*Manager).InitModuleServices
    /src/loki/vendor/github.com/grafana/dskit/modules/modules.go:108
github.com/grafana/loki/pkg/loki.(*Loki).Run
    /src/loki/pkg/loki/loki.go:461
main.main
    /src/loki/cmd/loki/main.go:110
runtime.main
    /usr/local/go/src/runtime/proc.go:271
runtime.goexit
    /usr/local/go/src/runtime/asm_amd64.s:1695
level=warn ts=2024-10-10T14:12:22.909657244Z caller=store.go:56 msg="running with DEPRECATED flag -store.max-look-back-period, use -querier.max-query-lookback instead."
level=warn ts=2024-10-10T14:12:22.909707754Z caller=loki.go:288 msg="global timeout not configured, using default engine timeout (\"5m0s\"). This behavior will change in the next major to always use the default global timeout (\"5m\")."
level=info ts=2024-10-10T14:12:22.911496473Z caller=main.go:108 msg="Starting Loki" version="(version=2.9.10, branch=HEAD, revision=7664eda07b)"
level=info ts=2024-10-10T14:12:22.912094614Z caller=server.go:322 http=[::]:3100 grpc=[::]:9095 msg="server listening on addresses"
level=error ts=2024-10-10T14:12:22.91311319Z caller=log.go:230 msg="error running loki" err="mkdir : no such file or directory\nerror initialising module: compactor\ngithub.com/grafana/dskit/modules.(*Manager).initModule\n\t/src/loki/vendor/github.com/grafana/dskit/modules/modules.go:138\ngithub.com/grafana/dskit/modules.(*Manager).InitModuleServices\n\t/src/loki/vendor/github.com/grafana/dskit/modules/modules.go:108\ngithub.com/grafana/loki/pkg/loki.(*Loki).Run\n\t/src/loki/pkg/loki/loki.go:461\nmain.main\n\t/src/loki/cmd/loki/main.go:110\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:271\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1695"

To Reproduce Steps to reproduce the behavior:

  1. Started Loki (0.79.4 chart version)

Expected behavior start compactor

Environment:

Nello-Angelo commented 1 day ago

i try to connect to minio but chart 0.76.1 works correct

Nello-Angelo commented 11 hours ago

charts with this versions are broken and i get this error

Image

this is because of that i think

Image

Nello-Angelo commented 11 hours ago

may be you have added feature in compactor and this failed

Nello-Angelo commented 10 hours ago

i tied to add working_directory: /var/loki/compactor but it did not help

    compactor:
      shared_store: s3
      compaction_interval: 10m
      retention_enabled: true
      retention_delete_delay: 2880h
      retention_delete_worker_count: 150
      working_directory: /var/loki/compactor