CrunchyData / crunchy-containers

Containers for Managing PostgreSQL on Kubernetes by Crunchy Data
https://www.crunchydata.com/
Apache License 2.0
1.01k stars 328 forks source link

PgBackRest 2.38 missing for CentOS builds #1438

Open tolleiv opened 2 years ago

tolleiv commented 2 years ago

Merge #1428 raised the PgBackRest version to 2.38, but this isn't available on the Yum Repositories, therefore building the most recent version 5.1.x won't succeed with centos based containers.

To Reproduce

export IMGBUILDER=docker
export CCP_BASEOS=centos8
export CCP_PGVERSION=14
export CCP_VERSION="5.1.1-0"

cd $CCPROOT
curl https://api.developers.crunchydata.com/downloads/repo/rpm-centos/postgresql14/crunchypg14.repo > conf/crunchypg14.repo

curl https://api.developers.crunchydata.com/downloads/gpg/RPM-GPG-KEY-crunchydata-dev > conf/RPM-GPG-KEY-crunchydata-dev

cd $CCPROOT
make setup

make setup
make postgres

will break with:

Error: Unable to find a match: crunchy-backrest-2.38

Expected behavior The builds should run successfully.

Please tell us about your environment:

Additional context

Using export CCP_BACKREST_VERSION=2.36 for the build will use the "old" pg_backrest version and builds will succeed, but version 2.38 is not available on any of the Yum repositories would be great if you could provide it.

olivejing commented 2 years ago

I also met this issue: No package matches 'crunchy-backrest-2.38' 11:35:12 (microdnf:13): librepo-WARNING **: 03:35:11.839: WARNING: Repomd xml parser: Unknown element "revision" 11:35:15 error: No package matches 'crunchy-backrest-2.38' 11:35:20 error building at STEP "RUN if [ "$DFSET" = "centos" ] ; then ${PACKAGER} -y install --nodocs openssh-clients openssh-server pgaudit${PG_MAJOR//.} pgaudit${PG_MAJOR//.}_set_user pg_partman_${PG_MAJOR//.} pg_cron_${PG_MAJOR//.} crunchy-backrest-${BACKREST_VER} postgresql${PG_MAJOR//.}-contrib postgresql${PG_MAJOR//.}-server postgresql${PG_MAJOR//.}-plpython* pgnodemx${PG_MAJOR//.} $( printf '11\n'${PG_MAJOR} | sort -VC && echo postgresql${PG_MAJOR}-llvmjit ) psmisc python3-pip python3-psutil python3-psycopg2 rsync $( printf '11\n'${PG_MAJOR} | sort -VC && echo timescaledb_${PG_MAJOR} ) wal2json_${PG_MAJOR//.} file gettext hostname procps-ng pgaudit_analyze unzip bzip2 lz4 krb5-workstation && ${PACKAGER} -y clean all ; else ${PACKAGER} -y install --nodocs --enablerepo="epel" openssh-clients openssh-server pgaudit${PG_MAJOR//.} pgaudit${PG_MAJOR//.}_set_user pg_partman_${PG_MAJOR//.} pg_cron_${PG_MAJOR//.} crunchy-backrest-${BACKREST_VER} postgresql${PG_MAJOR//.}-contrib postgresql${PG_MAJOR//.}-server postgresql${PG_MAJOR//.}-plpython* pgnodemx${PG_MAJOR//.} $( printf '11\n'${PG_MAJOR} | sort -VC && echo postgresql${PG_MAJOR}-llvmjit ) psmisc python3-pip python3-psutil python3-psycopg2 rsync $( printf '11\n'${PG_MAJOR} | sort -VC && echo timescaledb_${PG_MAJOR} ) wal2json_${PG_MAJOR//.} file unzip tar bzip2 lz4 krb5-workstation && ${PACKAGER} -y install --nodocs --setopt=tsflags='' --enablerepo="epel" pgaudit_analyze && ${PACKAGER} -y clean all --enablerepo="epel" ; fi": error while running runtime: exit status 1 11:35:20 make[1]: *** [Makefile:147: postgres-pgimg-build] Error 1 11:35:20 make[1]: Leaving directory '/go/src/github.com/CrunchyData/crunchy-containers' 11:35:20 make: *** [Makefile:22: build_image] Error 1 [Pipeline] }

olivejing commented 2 years ago

And CCP_PG_FULLVERSION ?= 13.7 is not support now. in repo https://repo.developers.crunchydata.com/postgresql13/centos/EL8/, no rpm for pg 13.7.

pere3 commented 2 years ago

you should check this out https://github.com/CrunchyData/crunchy-containers/pull/1475

it's a replacement for centos8 with official postgres repo attached

hint: you can also rename crunchy-backrest package installation to just pgbackrest and it will install from postgres repo https://download.postgresql.org/pub/repos/yum/common/redhat/rhel-8-x86_64/ cmd+f pgbackrest