getsentry / self-hosted

Sentry, feature-complete and packaged up for low-volume deployments and proofs-of-concept
https://develop.sentry.dev/self-hosted/
Other
7.76k stars 1.75k forks source link

failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3 #3341

Closed LocalHeroPro closed 1 hour ago

LocalHeroPro commented 4 days ago

Environment

SaaS (https://sentry.io/)

Steps to Reproduce

$ cat /etc/os-release 
PRETTY_NAME="Ubuntu 24.04.1 LTS"
NAME="Ubuntu"
VERSION_ID="24.04"
VERSION="24.04.1 LTS (Noble Numbat)"
VERSION_CODENAME=noble
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=noble
LOGO=ubuntu-logo
$ git checkout 24.9.0
$ docker-compose pull
Pulling smtp                                         ... 
Pulling memcached                                    ... 
Pulling redis                                        ... 
Pulling postgres                                     ... 
Pulling kafka                                        ... 
Pulling clickhouse                                   ... 
Pulling geoipupdate                                  ... 
Pulling snuba-api                                    ... 
Pulling snuba-errors-consumer                        ... 
Pulling snuba-outcomes-consumer                      ... 
Pulling snuba-outcomes-billing-consumer              ... 
Pulling snuba-group-attributes-consumer              ... 
Pulling snuba-replacer                               ... 
Pulling snuba-subscription-consumer-events           ... 
Pulling snuba-transactions-consumer                  ... 
Pulling snuba-replays-consumer                       ... 
Pulling snuba-issue-occurrence-consumer              ... 
Pulling snuba-metrics-consumer                       ... 
Pulling snuba-subscription-consumer-transactions     ... 
Pulling snuba-subscription-consumer-metrics          ... 
Pulling snuba-generic-metrics-distributions-consumer ... 
Pulling snuba-generic-metrics-sets-consumer          ... 
Pulling snuba-generic-metrics-counters-consumer      ... 
Pulling snuba-generic-metrics-gauges-consumer        ... 
Pulling snuba-profiling-profiles-consumer            ... 
Pulling snuba-profiling-functions-consumer           ... 
Pulling snuba-transactions-consumer                  ... download complete
Pulling symbolicator                                 ... download complete
Pulling symbolicator-cleanup                         ... done
Pulling web                                          ... done
Pulling cron                                         ... done
Pulling worker                                       ... done
Pulling events-consumer                              ... done
Pulling attachments-consumer                         ... done
Pulling post-process-forwarder-errors                ... done
Pulling subscription-consumer-events                 ... done
Pulling transactions-consumer                        ... done
Pulling metrics-consumer                             ... done
Pulling generic-metrics-consumer                     ... done
Pulling billing-metrics-consumer                     ... done
Pulling ingest-replay-recordings                     ... done
Pulling ingest-occurrences                           ... done
Pulling ingest-profiles                              ... done
Pulling ingest-monitors                              ... done
Pulling ingest-feedback-events                       ... done
Pulling monitors-clock-tick                          ... done
Pulling monitors-clock-tasks                         ... done
Pulling post-process-forwarder-transactions          ... done
Pulling post-process-forwarder-issue-platform        ... done
Pulling subscription-consumer-transactions           ... done
Pulling subscription-consumer-metrics                ... done
Pulling subscription-consumer-generic-metrics        ... done
Pulling sentry-cleanup                               ... done
Pulling relay                                        ... download complete
Pulling nginx                                        ... download complete
Pulling vroom                                        ... download complete
Pulling vroom-cleanup                                ... done

ERROR: for symbolicator  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for geoipupdate  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for snuba-errors-consumer  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for snuba-api  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for snuba-generic-metrics-counters-consumer  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for snuba-outcomes-billing-consumer  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for smtp  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for snuba-issue-occurrence-consumer  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for snuba-profiling-profiles-consumer  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for snuba-subscription-consumer-transactions  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for snuba-metrics-consumer  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for kafka  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for memcached  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for snuba-spans-consumer  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for snuba-profiling-functions-consumer  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for snuba-generic-metrics-distributions-consumer  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for snuba-subscription-consumer-metrics  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for snuba-replays-consumer  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for snuba-replacer  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for snuba-generic-metrics-sets-consumer  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for snuba-outcomes-consumer  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for relay  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for nginx  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for vroom  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for redis  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for snuba-subscription-consumer-events  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for snuba-group-attributes-consumer  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for snuba-generic-metrics-gauges-consumer  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for postgres  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: for snuba-transactions-consumer  failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

ERROR: failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3
$ ./install.sh 
.env.custom: line 21: KAFKA_LOG_RETENTION_HOURS:: command not found
▶ Parsing command line ...

▶ Detecting Docker platform
Detected Docker platform is linux/amd64

▶ Initializing Docker Compose ...

▶ Setting up error handling ...
#0 building with "default" instance using docker driver

getsentry/sentry#1 [internal] load build definition from Dockerfile
getsentry/sentry#1 transferring dockerfile: 292B done
getsentry/sentry#1 DONE 0.0s

getsentry/sentry#2 [internal] load metadata for docker.io/library/debian:bookworm-slim
getsentry/sentry#2 DONE 1.5s

getsentry/sentry#3 [internal] load .dockerignore
getsentry/sentry#3 transferring context: 2B done
getsentry/sentry#3 DONE 0.0s

getsentry/sentry#4 [1/2] FROM docker.io/library/debian:bookworm-slim@sha256:a629e796d77a7b2ff82186ed15d01a493801c020eed5ce6adaa2704356f15a1c
getsentry/sentry#4 resolve docker.io/library/debian:bookworm-slim@sha256:a629e796d77a7b2ff82186ed15d01a493801c020eed5ce6adaa2704356f15a1c 0.0s done
getsentry/sentry#4 sha256:a629e796d77a7b2ff82186ed15d01a493801c020eed5ce6adaa2704356f15a1c 1.85kB / 1.85kB done
getsentry/sentry#4 sha256:903d3225acecaa272bbdd7273c6c312c2af8b73644058838d23a8c9e6e5c82cf 529B / 529B done
getsentry/sentry#4 sha256:96d8cccd8a539589c2fd0d5a7a4009618d9a72051cf85eb05a5aae4f6ef55044 1.46kB / 1.46kB done
getsentry/sentry#4 sha256:a2318d6c47ec9cac5acc500c47c79602bcf953cec711a18bc898911a0984365b 0B / 29.13MB 0.1s
getsentry/sentry#4 sha256:a2318d6c47ec9cac5acc500c47c79602bcf953cec711a18bc898911a0984365b 5.24MB / 29.13MB 0.3s
getsentry/sentry#4 sha256:a2318d6c47ec9cac5acc500c47c79602bcf953cec711a18bc898911a0984365b 13.63MB / 29.13MB 0.5s
getsentry/sentry#4 sha256:a2318d6c47ec9cac5acc500c47c79602bcf953cec711a18bc898911a0984365b 20.97MB / 29.13MB 0.7s
getsentry/sentry#4 sha256:a2318d6c47ec9cac5acc500c47c79602bcf953cec711a18bc898911a0984365b 24.12MB / 29.13MB 0.8s
getsentry/sentry#4 sha256:a2318d6c47ec9cac5acc500c47c79602bcf953cec711a18bc898911a0984365b 29.13MB / 29.13MB 1.0s done
getsentry/sentry#4 extracting sha256:a2318d6c47ec9cac5acc500c47c79602bcf953cec711a18bc898911a0984365b
getsentry/sentry#4 ERROR: failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

------
 > [1/2] FROM docker.io/library/debian:bookworm-slim@sha256:a629e796d77a7b2ff82186ed15d01a493801c020eed5ce6adaa2704356f15a1c:
------
Dockerfile:1
--------------------
   1 | >>> FROM debian:bookworm-slim
   2 |     
   3 |     LABEL MAINTAINER="oss@sentry.io"
--------------------
ERROR: failed to solve: failed to register layer: exit status 22: unpigz: abort: zlib version less than 1.2.3

Expected Result

Can install and use Sentry.

Actual Result

Can't download either run ./install.sh. It ended with errors.

Product Area

Other

Link

No response

DSN

No response

Version

24.9.0

getsantry[bot] commented 4 days ago

Assigning to @getsentry/support for routing ⏲️

bijancot commented 1 day ago

judging from error messages, you can try to upgrade your zlib. You can check what version is installed on your machine using one of these command mentioned here https://www.quora.com/How-do-you-check-if-Zlib-is-installed-on-Linux

LocalHeroPro commented 15 hours ago

I have newest version 1:1.3.dfsg-3.1ubuntu2.1 for Ubuntu Noble Numbat. So no newest version. Docs: https://launchpad.net/ubuntu/+source/zlib

I think, that message comes from docker container.

Lint to the container: https://hub.docker.com/layers/library/debian/bookworm-slim/images/sha256-a629e796d77a7b2ff82186ed15d01a493801c020eed5ce6adaa2704356f15a1c

Log from main post point to this: https://hub.docker.com/layers/library/debian/bookworm-slim/images/sha256-903d3225acecaa272bbdd7273c6c312c2af8b73644058838d23a8c9e6e5c82cf?context=explore and there package zlib is in version 1.2.13

bijancot commented 6 hours ago

Actually that's not the problem. Because it's package that consist inside the container and not affected your machine at all as container behavior. This happen in OS layer. since pigz used by docker to doing compression etc (https://bitmovin.com/blog/docker-speed-test/#:~:text=Docker%20uses%20Pigz%20by%20default,read%2C%20write%2C%20and%20check.)

How about check your pigz version ?

pigz --version

Cheers Baskoro

LocalHeroPro commented 1 hour ago
$ pigz --version
pigz: abort: zlib version less than 1.2.3

and

$ apt show pigz
Package: pigz
Version: 2.6-1
Status: install ok installed
Priority: optional
Section: utils
Maintainer: Ubuntu Developers <ubuntu-devel-discuss@lists.ubuntu.com>
Original-Maintainer: Eduard Bloch <blade@debian.org>
Installed-Size: 162 kB
Pre-Depends: dpkg (>= 1.15.6)
Depends: libc6 (>= 2.33), zlib1g (>= 1:1.2.6)
Homepage: http://zlib.net/pigz/
Download-Size: unknown
APT-Manual-Installed: yes
APT-Sources: /var/lib/dpkg/status
Description: Parallel Implementation of GZip
 pigz, which stands for Parallel Implementation of GZip, is a fully functional
 replacement for gzip that takes advantage of multiple processors and multiple
 cores when compressing data.

and MAN page says: https://launchpad.net/ubuntu/+source/pigz that for Noble Numbat newest version is 2.8-1, . Updating and dist-upgrade doesn't upgrade that package ;/ but it's marked as unstable.

bijancot commented 1 hour ago

look like it's getting weird and weirder maybe try to downgrade pigz will help. But again i'am not sure,

Another tings that maybe works try to look for zlib on another repository and install it manually from there or maybe a .deb package for newer zlib available out there ( but you know kinda not save)

LocalHeroPro commented 1 hour ago

hehehe

$ sudo apt purge pigz
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following packages will be REMOVED:
  pigz*
0 upgraded, 0 newly installed, 1 to remove and 3 not upgraded.
After this operation, 162 kB disk space will be freed.
Do you want to continue? [Y/n] 
(Reading database ... 194867 files and directories currently installed.)
Removing pigz (2.6-1) ...
Processing triggers for man-db (2.12.0-4build2) ...

$ sudo apt install pigz
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
Package pigz is not available, but is referred to by another package.
This may mean that the package is missing, has been obsoleted, or
is only available from another source

E: Package 'pigz' has no installation candidate

$ ./install.sh

and installation processing ;) and Sentry boot up ;)

I'm closing this ticket. Thanks.