Python 3.9 migration & container build fixes

[rsevilla87]

Signed-off-by: Raul Sevilla rsevilla@redhat.com

Description

Most of builds for arm64 amd amd64 archs have been fixed. Some findings of the failed ones:

• We're unable to build oslat container since the packages rt-tests and dumb-init are not longer available in the repos. cc: @smalleni
• Cyclitest build fails due to broken link to the rt-tests RPM, in addition, we should avoid using static links as builds won't work for multiarch builds. cc @smalleni
• Hammerdb for arm64 fails due to there's no offial odbc driver for arm64. cc @mkarg75

Fixes

[codecov-commenter]

Codecov Report

Merging #354 (dcb9e07) into master (47f907c) will not change coverage. The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #354   +/-   ##
=======================================
  Coverage   39.40%   39.40%           
=======================================
  Files          15       15           
  Lines         868      868           
=======================================
  Hits          342      342           
  Misses        526      526           

Flag	Coverage Δ
gha	39.40% <ø> (ø)
python-3.6	39.40% <ø> (ø)
unit	39.40% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

---

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update 47f907c...dcb9e07. Read the comment docs.

[comet-perf-ci]

Results for SNAFU CI Test

Test	Result	Runtime
Report\n>	FAIL	00:00:00

[comet-perf-ci]

Results for SNAFU CI Test

Test	Result	Runtime
snafu/benchmarks/uperf	FAIL	00:45:01
snafu/cyclictest_wrapper	FAIL	00:00:00
snafu/dns_perf_wrapper	FAIL	00:00:00
snafu/fio_wrapper	PASS	00:16:22
snafu/flent_wrapper	FAIL	00:00:40
snafu/fs_drift_wrapper	PASS	00:04:28
snafu/hammerdb	PASS	00:08:38
snafu/image_pull_wrapper	PASS	00:03:23
snafu/linpack_wrapper	FAIL	00:00:00
snafu/log_generator_wrapper	PASS	00:03:32
snafu/oslat_wrapper	FAIL	00:00:00
snafu/pgbench_wrapper	PASS	00:03:21
snafu/scale_openshift_wrapper	PASS	00:06:06
snafu/smallfile_wrapper	PASS	00:05:40
snafu/stressng_wrapper	PASS	00:03:17
snafu/sysbench	PASS	00:02:55
snafu/trex_wrapper	FAIL	00:00:00
snafu/upgrade_openshift_wrapper	PASS	00:00:00
snafu/vegeta_wrapper	PASS	00:04:00
snafu/ycsb_wrapper	PASS	00:05:28

[comet-perf-ci]

Results for SNAFU CI Test

Test	Result	Runtime
snafu/benchmarks/uperf	FAIL	00:43:45
snafu/cyclictest_wrapper	FAIL	00:00:00
snafu/dns_perf_wrapper	FAIL	00:00:00
snafu/fio_wrapper	PASS	00:16:52
snafu/flent_wrapper	PASS	00:08:18
snafu/fs_drift_wrapper	PASS	00:04:38
snafu/hammerdb	PASS	00:06:36
snafu/image_pull_wrapper	PASS	00:03:13
snafu/linpack_wrapper	FAIL	00:00:00
snafu/log_generator_wrapper	PASS	00:03:10
snafu/oslat_wrapper	FAIL	00:00:00
snafu/pgbench_wrapper	PASS	00:03:33
snafu/scale_openshift_wrapper	PASS	00:07:39
snafu/smallfile_wrapper	PASS	00:08:12
snafu/stressng_wrapper	PASS	00:03:24
snafu/sysbench	PASS	00:02:54
snafu/trex_wrapper	FAIL	00:00:00
snafu/upgrade_openshift_wrapper	PASS	00:00:00
snafu/vegeta_wrapper	PASS	00:04:04
snafu/ycsb_wrapper	PASS	00:05:31

[jtaleric]

@smalleni @mukrishn Status code: 404 for https://www.rpmfind.net/linux/centos/8-stream/AppStream/x86_64/os/Packages/rt-tests-1.9-2.el8.x86_64.rpm (IP: 195.220.108.108) error building at STEP "RUN dnf -y install https://www.rpmfind.net/linux/centos/8-stream/AppStream/x86_64/os/Packages/rt-tests-1.9-2.el8.x86_64.rpm": error while running runtime: exit status 1

[comet-perf-ci]

Results for SNAFU CI Test

Test	Result	Runtime
snafu/benchmarks/uperf	FAIL	00:03:13
snafu/cyclictest_wrapper	FAIL	00:00:00
snafu/dns_perf_wrapper	FAIL	00:00:00
snafu/fio_wrapper	FAIL	00:02:06
snafu/flent_wrapper	FAIL	00:04:49
snafu/fs_drift_wrapper	FAIL	00:01:29
snafu/hammerdb	FAIL	00:02:20
snafu/image_pull_wrapper	FAIL	00:01:29
snafu/linpack_wrapper	FAIL	00:00:00
snafu/log_generator_wrapper	FAIL	00:01:38
snafu/oslat_wrapper	FAIL	00:00:00
snafu/pgbench_wrapper	FAIL	00:01:59
snafu/scale_openshift_wrapper	FAIL	00:01:52
snafu/smallfile_wrapper	FAIL	00:01:30
snafu/stressng_wrapper	FAIL	00:01:50
snafu/sysbench	FAIL	00:01:42
snafu/trex_wrapper	FAIL	00:00:00
snafu/upgrade_openshift_wrapper	PASS	00:00:00
snafu/vegeta_wrapper	FAIL	00:01:34
snafu/ycsb_wrapper	FAIL	00:03:04

[rsevilla87]

@rsevilla87 since you're at it with upgrading to 3.9, can you also add in an extra line for these Dockerfiles to install dependencies from requirements/py39-reqs/install.txt? Also do we have any idea on what to do with the builds that are still failing? It would be great if we could get all these images fixed in this PR. For a temporary workaround on the 404 errors on cyclictest, I figured we could extract the rpm from our current images and store them under snafu/image_resources, then do the download from GH.

I've updated the images for cyclitest and oslat to fedora, as those RPMs are not available in the official repositories anymore. Not sure if we want to move forward from here.

[learnitall]

/rerun all

[comet-perf-ci]

Results for SNAFU CI Test

Test	Result	Runtime
snafu/benchmarks/uperf	FAIL	00:02:00
snafu/cyclictest_wrapper	FAIL	00:00:00
snafu/dns_perf_wrapper	FAIL	00:00:00
snafu/fio_wrapper	FAIL	00:02:06
snafu/flent_wrapper	FAIL	00:03:15
snafu/fs_drift_wrapper	FAIL	00:01:34
snafu/hammerdb	FAIL	00:02:27
snafu/image_pull_wrapper	FAIL	00:01:30
snafu/linpack_wrapper	FAIL	00:00:00
snafu/log_generator_wrapper	FAIL	00:01:53
snafu/oslat_wrapper	FAIL	00:00:00
snafu/pgbench_wrapper	FAIL	00:01:59
snafu/scale_openshift_wrapper	FAIL	00:01:51
snafu/smallfile_wrapper	FAIL	00:01:34
snafu/stressng_wrapper	FAIL	00:01:49
snafu/sysbench	FAIL	00:01:43
snafu/trex_wrapper	FAIL	00:00:00
snafu/upgrade_openshift_wrapper	PASS	00:00:00
snafu/vegeta_wrapper	FAIL	00:01:34
snafu/ycsb_wrapper	FAIL	00:03:05

[learnitall]

/rerun all

[comet-perf-ci]

Results for SNAFU CI Test

Test	Result	Runtime
snafu/benchmarks/uperf	FAIL	00:42:45
snafu/cyclictest_wrapper	FAIL	00:00:00
snafu/dns_perf_wrapper	FAIL	00:00:00
snafu/fio_wrapper	PASS	00:17:23
snafu/flent_wrapper	PASS	00:07:49
snafu/fs_drift_wrapper	PASS	00:04:23
snafu/hammerdb	PASS	00:05:58
snafu/image_pull_wrapper	PASS	00:03:19
snafu/linpack_wrapper	FAIL	00:00:00
snafu/log_generator_wrapper	PASS	00:03:18
snafu/oslat_wrapper	FAIL	00:00:00
snafu/pgbench_wrapper	PASS	00:03:24
snafu/scale_openshift_wrapper	PASS	00:05:42
snafu/smallfile_wrapper	PASS	00:05:33
snafu/stressng_wrapper	PASS	00:03:10
snafu/sysbench	PASS	00:02:41
snafu/trex_wrapper	FAIL	00:00:00
snafu/upgrade_openshift_wrapper	PASS	00:00:00
snafu/vegeta_wrapper	PASS	00:04:07
snafu/ycsb_wrapper	PASS	00:04:55

[comet-perf-ci]

Results for SNAFU CI Test

Test	Result	Runtime
snafu/benchmarks/uperf	PASS	00:27:16
snafu/cyclictest_wrapper	FAIL	00:00:00
snafu/dns_perf_wrapper	FAIL	00:00:00
snafu/fio_wrapper	PASS	00:16:00
snafu/flent_wrapper	PASS	00:08:05
snafu/fs_drift_wrapper	PASS	00:04:10
snafu/hammerdb	PASS	00:05:57
snafu/image_pull_wrapper	PASS	00:03:08
snafu/linpack_wrapper	FAIL	00:00:00
snafu/log_generator_wrapper	PASS	00:03:04
snafu/oslat_wrapper	FAIL	00:00:00
snafu/pgbench_wrapper	PASS	00:03:32
snafu/scale_openshift_wrapper	PASS	00:09:38
snafu/smallfile_wrapper	PASS	00:05:33
snafu/stressng_wrapper	PASS	00:03:31
snafu/sysbench	PASS	00:02:42
snafu/trex_wrapper	FAIL	00:00:00
snafu/upgrade_openshift_wrapper	PASS	00:00:00
snafu/vegeta_wrapper	PASS	00:04:28
snafu/ycsb_wrapper	PASS	00:05:30