Fatal: Can't initialize Background Jobs. Error message: Operation not permitted

[luispimenta]

Description of problem

I can't start redis in dokku

Steps to Reproduce

1. dokku version 0.21.4
2. sudo dokku plugin:install https://github.com/dokku/dokku-redis.git redis

Actual Results

redis:7.2.5 "docker-entrypoint.s…" 6 hours ago Restarting (1) 39 seconds ago

Expected Results

redis works fine

Environment Information

dokku report APP_NAME output

dokku report APP_NAME

-----> uname: Linux ip-xxx 5.4.0-1030-aws #31-Ubuntu SMP Fri Nov 13 11:40:37 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
-----> memory:
                     total        used        free      shared  buff/cache   available
       Mem:           3933        3304         163         135         465         261
       Swap:             0           0           0
-----> docker version:
       Client: Docker Engine - Community
        Version:           19.03.13
        API version:       1.40
        Go version:        go1.13.15
        Git commit:        4484c46d9d
        Built:             Wed Sep 16 17:02:52 2020
        OS/Arch:           linux/amd64
        Experimental:      false

       Server: Docker Engine - Community
        Engine:
         Version:          19.03.13
         API version:      1.40 (minimum version 1.12)
         Go version:       go1.13.15
         Git commit:       4484c46d9d
         Built:            Wed Sep 16 17:01:20 2020
         OS/Arch:          linux/amd64
         Experimental:     false
        containerd:
         Version:          1.3.7
         GitCommit:        8fba4e9a7d01810a393d5d25a3621dc101981175
        runc:
         Version:          1.0.0-rc10
         GitCommit:        dc9208a3303feef5b3839f4323d9beb36df0a9dd
        docker-init:
         Version:          0.18.0
         GitCommit:        fec3683
-----> docker daemon info:
WARNING: No swap limit support
       Client:
        Debug Mode: true

       Server:
        Containers: 16
         Running: 6
         Paused: 0
         Stopped: 10
        Images: 35
        Server Version: 19.03.13
        Storage Driver: overlay2
         Backing Filesystem: extfs
         Supports d_type: true
         Native Overlay Diff: true
        Logging Driver: json-file
        Cgroup Driver: cgroupfs
        Plugins:
         Volume: local
         Network: bridge host ipvlan macvlan null overlay
         Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
        Swarm: inactive
        Runtimes: runc
        Default Runtime: runc
        Init Binary: docker-init
        containerd version: 8fba4e9a7d01810a393d5d25a3621dc101981175
        runc version: dc9208a3303feef5b3839f4323d9beb36df0a9dd
        init version: fec3683
        Security Options:
         apparmor
         seccomp
          Profile: default
        Kernel Version: 5.4.0-1030-aws
        Operating System: Ubuntu 20.04.1 LTS
        OSType: linux
        Architecture: x86_64
        CPUs: 2
        Total Memory: 3.842GiB
        Name: ip-xxx
        ID: ZEUA:AHTD:S3AE:TSZC:CYWX:N3CX:GE6I:ZRHS:O345:7MT7:UY6E:FZWT
        Docker Root Dir: /var/lib/docker
        Debug Mode: false
        Registry: https://index.docker.io/v1/
        Labels:
        Experimental: false
        Insecure Registries:
         127.0.0.0/8
        Live Restore Enabled: false

-----> sigil version: 0.6.0
-----> herokuish version:
       herokuish: v0.9.2
       buildpacks:
         heroku-buildpack-multi     v1.2.0
         heroku-buildpack-ruby      v272
         heroku-buildpack-nodejs    v254
         heroku-buildpack-clojure   v91
         heroku-buildpack-python    v252
         heroku-buildpack-java      v73
         heroku-buildpack-gradle    v39
         heroku-buildpack-scala     v98
         heroku-buildpack-play      v26
         heroku-buildpack-php       v253
         heroku-buildpack-go        v192
         heroku-buildpack-nginx     v25
         buildpack-null             v3
-----> dokku version: dokku version 0.21.4
-----> dokku plugins:
       plugn: 0.5.0
         00_dokku-standard    0.21.4 enabled    dokku core standard plugin
         20_events            0.21.4 enabled    dokku core events logging plugin
         app-json             0.21.4 enabled    dokku core app-json plugin
         apps                 0.21.4 enabled    dokku core apps plugin
         builder-dockerfile   0.21.4 enabled    dokku core builder-dockerfile plugin
         builder-herokuish    0.21.4 enabled    dokku core builder-herokuish plugin
         buildpacks           0.21.4 enabled    dokku core buildpacks plugin
         certs                0.21.4 enabled    dokku core certificate management plugin
         checks               0.21.4 enabled    dokku core checks plugin
         common               0.21.4 enabled    dokku core common plugin
         config               0.21.4 enabled    dokku core config plugin
         docker-options       0.21.4 enabled    dokku core docker-options plugin
         domains              0.21.4 enabled    dokku core domains plugin
         enter                0.21.4 enabled    dokku core enter plugin
         git                  0.21.4 enabled    dokku core git plugin
         letsencrypt          0.20.3 enabled    Automated installation of let's encrypt TLS certificates
         logs                 0.21.4 enabled    dokku core logs plugin
         network              0.21.4 enabled    dokku core network plugin
         nginx-max-upload-size 0.1.4 enabled    Set the NGINX maximum upload file size
         nginx-vhosts         0.21.4 enabled    dokku core nginx-vhosts plugin
         plugin               0.21.4 enabled    dokku core plugin plugin
         postgres             1.11.5 enabled    dokku postgres service plugin
         proxy                0.21.4 enabled    dokku core proxy plugin
         ps                   0.21.4 enabled    dokku core ps plugin
         redis                1.37.6 enabled    dokku redis service plugin
         repo                 0.21.4 enabled    dokku core repo plugin
         resource             0.21.4 enabled    dokku core resource plugin
         scheduler-docker-local 0.21.4 enabled    dokku core scheduler-docker-local plugin
         shell                0.21.4 enabled    dokku core shell plugin
         sidekiq              0.1.0 enabled    support for sidekiq via post-deploy hook
         ssh-keys             0.21.4 enabled    dokku core ssh-keys plugin
         storage              0.21.4 enabled    dokku core storage plugin
         tags                 0.21.4 enabled    dokku core tags plugin
         tar                  0.21.4 enabled    dokku core tar plugin
         trace                0.21.4 enabled    dokku core trace plugin
=====> APP_NAMEapp information
       App deploy source:
       App dir:                       /home/dokku/APP_NAME
       App locked:                    false
=====> APP_NAME buildpacks information
       Buildpacks list:
xargs: unmatched single quote; by default quotes are special to xargs unless you use the -0 option
CN = app.xxx
error 20 at 0 depth lookup: unable to get local issuer certificate
=====> APP_NAME ssl information
       Ssl dir:                       /home/dokku/APP_NAME/tls
       Ssl enabled:                   true
       Ssl hostnames:                 app.xxx
       Ssl expires at:                Nov  5 23:01:36 2024 GMT
       Ssl issuer:                    C = US, O =
       Ssl starts at:                 Aug  7 23:01:37 2024 GMT
       Ssl subject:                   subject=CN = app.xxx
       Ssl verified:                  self signed
=====> APP_NAME checks information
       Checks disabled list:          none
       Checks skipped list:           none
=====> APP_NAME docker options information
       Docker options build:          --link dokku.redis.APP_NAME-redis:dokku-redis-APP_NAME-redis
       Docker options deploy:         --link dokku.redis.APP_NAME-redis:dokku-redis-APP_NAME-redis --restart=on-failure:10
       Docker options run:            --link dokku.redis.APP_NAME-redis:dokku-redis-APP_NAME-redis
=====> APP_NAME domains information
       Domains app enabled:           true
       Domains app vhosts:            app.xxx
       Domains global enabled:        true
       Domains global vhosts:         ip-xxx
=====> APP_NAME git information
       Git deploy branch:             master
       Git global deploy branch:      master
       Git keep git dir:              false
       Git rev env var:               GIT_REV
       Git sha:                       2441906
       Git last updated at:
=====> APP_NAME letsencrypt information
       Letsencrypt active:            true
       Letsencrypt autorenew:         true
       Letsencrypt computed dns provider:
       Letsencrypt global dns provider:
       Letsencrypt dns provider:
       Letsencrypt computed email:    app@xxx
       Letsencrypt global email:
       Letsencrypt email:             app@xxx
       Letsencrypt expiration:        1730847696
       Letsencrypt computed graceperiod: 2592000
       Letsencrypt global graceperiod:
       Letsencrypt graceperiod:
       Letsencrypt computed lego docker args:
       Letsencrypt global lego docker args:
       Letsencrypt lego docker args:
       Letsencrypt computed server:   https://acme-v02.api.letsencrypt.org/directory
       Letsencrypt global server:
       Letsencrypt server:
=====> APP_NAME network information
       Network attach post create:
       Network attach post deploy:
       Network bind all interfaces:   false
       Network web listeners:         xxx:5000
=====> APP_NAME nginx information
       Nginx access log path:         /var/log/nginx/APP_NAME-access.log
       Nginx bind address ipv4:
       Nginx bind address ipv6:       ::
       Nginx error log path:          /var/log/nginx/APP_NAME-error.log
       Nginx hsts:                    true
       Nginx hsts include subdomains: true
       Nginx hsts max age:            15724800
       Nginx hsts preload:            false
       Nginx proxy read timeout:      60s
       Nginx last visited at:         1727279908
=====> APP_NAME proxy information
       Proxy enabled:                 true
       Proxy port map:                http:80:5000 https:443:5000
       Proxy type:                    nginx
=====> APP_NAME ps information
       Processes:                     1
       Deployed:                      true
       Running:                       true
       Restore:                       true
       Restart policy:                on-failure:10
       Ps can scale:                  true
       Status web.1:                  running    (CID: 9cc60547e686)
=====> APP_NAME scheduler-docker-local information
       Scheduler docker local disable chown:
=====> APP_NAME storage information
       Storage build mounts:
       Storage deploy mounts:
       Storage run mounts:

How (deb/make) and where (AWS, VirtualBox, physical, etc.) was Dokku installed?:

aws

[josegonzalez]

A few things:

• That version of Dokku is ancient. Please upgrade, as I'm not going to spend time trying to install a version that came out 4 years ago.
• I need the logs of the dokku-redis container. Without that, I have no idea why its restarting.
• Can you post the output of dokku redis:info $REDIS_SERVICE for your $REDIS_SERVICE?
• Your reproduction steps don't get to the phase where the service was started, nor the output of those commands. It just says to install the plugin, which wouldn't get you the error message you are seeing. In the future, please include all the steps necessary here.

[luispimenta]

@josegonzalez Thank you for your quick response! Indeed, when I updated the dokku version, everything went well with redis, I even found the PR that added vm.overcommit_memory=1

Thank you again for your support, I'll close it