kubevirt / containerized-data-importer

Data Import Service for kubernetes, designed with kubevirt in mind.
Apache License 2.0
413 stars 258 forks source link

Unable to build docker image from source? #3332

Closed Lighterer closed 2 weeks ago

Lighterer commented 3 months ago

I want to build a docker image from the source code, but following the steps in the documentation, I can't successfully build it. I'm new to Bazel and would like to ask what might be causing the issue.

I tried make all and make bazel-build-images, both had no errors, but the image was not built.

Environment:

Additional context: Build log:

# make bazel-build-images
./hack/build/bazel-docker.sh "BUILD_ARCH=x86_64 ./hack/build/bazel-generate.sh -- staging/src pkg/ tools/ tests/ cmd/"
CDI_CRI: docker, CDI_CONTAINER_BUILDCMD: docker
Making sure output directory exists...
go version go1.22.3 linux/amd64
go version go1.22.3 linux/amd64
Starting rsyncd

Rsyncing /root/go/src/kubevirt.io/containerized-data-importer to container
9ce27ad858a3d930ee1f4bbb509e17c6c4c3c23845144ddcbc22503a12fe8bf6
Starting bazel server
go version go1.22.3 linux/amd64
CDI_CRI: docker, CDI_CONTAINER_BUILDCMD: docker
Another command holds the client lock:
pid=14
owner=client
cwd=/root/go/src/kubevirt.io/containerized-data-importer

Waiting for it to complete...
Another command (pid=14) is running. Waiting for it to complete on the server (server_pid=18)...
INFO: Analyzed target //:gazelle (91 packages loaded, 10969 targets configured).
INFO: Found 1 target...
Target //:gazelle up-to-date:
  bazel-bin/gazelle-runner.bash
  bazel-bin/gazelle
INFO: Elapsed time: 69.390s, Critical Path: 41.47s
INFO: 59 processes: 16 internal, 43 processwrapper-sandbox.
INFO: Build completed successfully, 59 total actions
INFO: Build completed successfully, 59 total actions
./hack/build/bazel-docker.sh "BUILD_ARCH=x86_64 ./hack/build/bazel-build.sh"
CDI_CRI: docker, CDI_CONTAINER_BUILDCMD: docker
Making sure output directory exists...
go version go1.22.3 linux/amd64
go version go1.22.3 linux/amd64
Starting rsyncd

Rsyncing /root/go/src/kubevirt.io/containerized-data-importer to container
Starting bazel server
go version go1.22.3 linux/amd64
CDI_CRI: docker, CDI_CONTAINER_BUILDCMD: docker
INFO: Analyzed 31 targets (1456 packages loaded, 11772 targets configured).
INFO: Found 31 targets...
INFO: From Compiling src/google/protobuf/message_lite.cc:
In file included from /usr/include/string.h:519,
                 from external/com_google_protobuf/src/google/protobuf/stubs/port.h:38,
                 from external/com_google_protobuf/src/google/protobuf/stubs/common.h:46,
                 from external/com_google_protobuf/src/google/protobuf/message_lite.h:45,
                 from external/com_google_protobuf/src/google/protobuf/message_lite.cc:36:
In function 'void* memcpy(void*, const void*, size_t)',
    inlined from 'google::protobuf::uint8* google::protobuf::io::EpsCopyOutputStream::WriteRaw(const void*, int, google::protobuf::uint8*)' at external/com_google_protobuf/src/google/protobuf/io/coded_stream.h:697:16,
    inlined from 'virtual google::protobuf::uint8* google::protobuf::internal::ImplicitWeakMessage::InternalSerializeWithCachedSizesToArray(google::protobuf::uint8*, google::protobuf::io::EpsCopyOutputStream*) const' at external/com_google_protobuf/src/google/protobuf/implicit_weak_message.h:87:28,
    inlined from 'bool google::protobuf::MessageLite::SerializePartialToZeroCopyStream(google::protobuf::io::ZeroCopyOutputStream*) const' at external/com_google_protobuf/src/google/protobuf/message_lite.cc:387:51:
/usr/include/bits/string_fortified.h:29:33: warning: 'void* __builtin___memcpy_chk(void*, const void*, long unsigned int, long unsigned int)' specified size between 18446744071562067968 and 18446744073709551615 exceeds maximum object size 9223372036854775807 [-Wstringop-overflow=]
   29 |   return __builtin___memcpy_chk (__dest, __src, __len,
      |          ~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~
   30 |                                  __glibc_objsize0 (__dest));
      |                                  ~~~~~~~~~~~~~~~~~~~~~~~~~~
INFO: Elapsed time: 197.144s, Critical Path: 83.43s
INFO: 1790 processes: 94 internal, 1696 processwrapper-sandbox.
INFO: Build completed successfully, 1790 total actions
./hack/build/bazel-docker.sh "BUILD_ARCH=x86_64 DOCKER_PREFIX= DOCKER_TAG= ./hack/build/bazel-build-images.sh"
CDI_CRI: docker, CDI_CONTAINER_BUILDCMD: docker
Making sure output directory exists...
go version go1.22.3 linux/amd64
go version go1.22.3 linux/amd64
Starting rsyncd

Rsyncing /root/go/src/kubevirt.io/containerized-data-importer to container
Starting bazel server
go version go1.22.3 linux/amd64
CDI_CRI: docker, CDI_CONTAINER_BUILDCMD: docker
INFO: Build option --define has changed, discarding analysis cache.
INFO: Analyzed 8 targets (83 packages loaded, 22467 targets configured).
INFO: Found 8 targets...
INFO: From Install RPMs inside a container:
./usr/lib64/python3.9/site-packages/ovirt_imageio/client
./usr/lib64/python3.9/site-packages/ovirt_imageio/client/__init__.py
./usr/lib64/python3.9/site-packages/ovirt_imageio/client/__pycache__
./usr/lib64/python3.9/site-packages/ovirt_imageio/client/_api.py
./usr/lib64/python3.9/site-packages/ovirt_imageio/client/_ui.py
./usr/lib64/python3.9/site-packages/ovirt_imageio/client/__pycache__/__init__.cpython-39.opt-1.pyc
cpio: ./usr/lib64/python3.9/site-packages/ovirt_imageio/client/__pycache__/__init__.cpython-39.pyc linked to ./usr/lib64/python3.9/site-packages/ovirt_imageio/client/__pycache__/__init__.cpython-39.opt-1.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/client/__pycache__/__init__.cpython-39.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/client/__pycache__/_api.cpython-39.opt-1.pyc
cpio: ./usr/lib64/python3.9/site-packages/ovirt_imageio/client/__pycache__/_api.cpython-39.pyc linked to ./usr/lib64/python3.9/site-packages/ovirt_imageio/client/__pycache__/_api.cpython-39.opt-1.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/client/__pycache__/_api.cpython-39.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/client/__pycache__/_ui.cpython-39.opt-1.pyc
cpio: ./usr/lib64/python3.9/site-packages/ovirt_imageio/client/__pycache__/_ui.cpython-39.pyc linked to ./usr/lib64/python3.9/site-packages/ovirt_imageio/client/__pycache__/_ui.cpython-39.opt-1.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/client/__pycache__/_ui.cpython-39.pyc
88 blocks
./usr/lib/.build-id
./usr/lib/.build-id/fa
./usr/lib/.build-id/fa/c6ab94ecf119f2437216e6ca9fe80fb6beeb12
./usr/lib64/python3.9/site-packages/ovirt_imageio
./usr/lib64/python3.9/site-packages/ovirt_imageio-2.4.3-py3.9.egg-info
./usr/lib64/python3.9/site-packages/ovirt_imageio-2.4.3-py3.9.egg-info/PKG-INFO
./usr/lib64/python3.9/site-packages/ovirt_imageio-2.4.3-py3.9.egg-info/SOURCES.txt
./usr/lib64/python3.9/site-packages/ovirt_imageio-2.4.3-py3.9.egg-info/dependency_links.txt
./usr/lib64/python3.9/site-packages/ovirt_imageio-2.4.3-py3.9.egg-info/top_level.txt
./usr/lib64/python3.9/site-packages/ovirt_imageio/__init__.py
./usr/lib64/python3.9/site-packages/ovirt_imageio/__pycache__
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/__init__.py
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/__pycache__
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/__pycache__/blkhash.cpython-39.opt-1.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/__pycache__/blkhash.cpython-39.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/__pycache__/nbd.cpython-39.opt-1.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/__pycache__/nbd.cpython-39.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/__pycache__/server.cpython-39.opt-1.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/__pycache__/server.cpython-39.pyc
......
......
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/ssl.py
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/stats.py
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/uhttp.py
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/util.py
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/validate.py
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/version.py
./usr/share/licenses/ovirt-imageio-common
./usr/share/licenses/ovirt-imageio-common/COPYING
./usr/lib64/python3.9/site-packages/ovirt_imageio/__pycache__/__init__.cpython-39.opt-1.pyc
cpio: ./usr/lib64/python3.9/site-packages/ovirt_imageio/__pycache__/__init__.cpython-39.pyc linked to ./usr/lib64/python3.9/site-packages/ovirt_imageio/__pycache__/__init__.cpython-39.opt-1.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/__pycache__/__init__.cpython-39.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/__pycache__/__init__.cpython-39.opt-1.pyc
cpio: ./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/__pycache__/__init__.cpython-39.pyc linked to ./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/__pycache__/__init__.cpython-39.opt-1.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/__pycache__/__init__.cpython-39.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/__pycache__/auth.cpython-39.opt-1.pyc
cpio: ./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/__pycache__/auth.cpython-39.pyc linked to ./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/__pycache__/auth.cpython-39.opt-1.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/__pycache__/auth.cpython-39.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/__pycache__/config.cpython-39.opt-1.pyc
cpio: ./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/__pycache__/config.cpython-39.pyc linked to ./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/__pycache__/config.cpython-39.opt-1.pyc
......
......
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/handlers/__pycache__/images.cpython-39.opt-1.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/handlers/__pycache__/images.cpython-39.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/handlers/__pycache__/info.cpython-39.opt-1.pyc
cpio: ./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/handlers/__pycache__/info.cpython-39.pyc linked to ./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/handlers/__pycache__/info.cpython-39.opt-1.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/handlers/__pycache__/info.cpython-39.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/handlers/__pycache__/profile.cpython-39.opt-1.pyc
cpio: ./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/handlers/__pycache__/profile.cpython-39.pyc linked to ./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/handlers/__pycache__/profile.cpython-39.opt-1.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/handlers/__pycache__/profile.cpython-39.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/handlers/__pycache__/tickets.cpython-39.opt-1.pyc
cpio: ./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/handlers/__pycache__/tickets.cpython-39.pyc linked to ./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/handlers/__pycache__/tickets.cpython-39.opt-1.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/_internal/handlers/__pycache__/tickets.cpython-39.pyc
1242 blocks
./etc/ovirt-imageio
./etc/ovirt-imageio/README
./etc/ovirt-imageio/conf.d
./usr/bin/ovirt-imageio
./usr/bin/ovirt-imageioctl
./usr/lib/ovirt-imageio
./usr/lib/ovirt-imageio/conf.d
./usr/lib/systemd/system/ovirt-imageio.service
./usr/lib64/python3.9/site-packages/ovirt_imageio/admin
./usr/lib64/python3.9/site-packages/ovirt_imageio/admin/__init__.py
./usr/lib64/python3.9/site-packages/ovirt_imageio/admin/__pycache__
./usr/lib64/python3.9/site-packages/ovirt_imageio/admin/_api.py
./usr/lib64/python3.9/site-packages/ovirt_imageio/admin/tool.py
./var/log/ovirt-imageio
./usr/lib64/python3.9/site-packages/ovirt_imageio/admin/__pycache__/__init__.cpython-39.opt-1.pyc
cpio: ./usr/lib64/python3.9/site-packages/ovirt_imageio/admin/__pycache__/__init__.cpython-39.pyc linked to ./usr/lib64/python3.9/site-packages/ovirt_imageio/admin/__pycache__/__init__.cpython-39.opt-1.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/admin/__pycache__/__init__.cpython-39.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/admin/__pycache__/_api.cpython-39.opt-1.pyc
cpio: ./usr/lib64/python3.9/site-packages/ovirt_imageio/admin/__pycache__/_api.cpython-39.pyc linked to ./usr/lib64/python3.9/site-packages/ovirt_imageio/admin/__pycache__/_api.cpython-39.opt-1.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/admin/__pycache__/_api.cpython-39.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/admin/__pycache__/tool.cpython-39.opt-1.pyc
cpio: ./usr/lib64/python3.9/site-packages/ovirt_imageio/admin/__pycache__/tool.cpython-39.pyc linked to ./usr/lib64/python3.9/site-packages/ovirt_imageio/admin/__pycache__/tool.cpython-39.opt-1.pyc
./usr/lib64/python3.9/site-packages/ovirt_imageio/admin/__pycache__/tool.cpython-39.pyc
57 blocks
Verifying packages...
Preparing packages...
ovirt-imageio-client-2.4.3-1.el9.x86_64
Verifying packages...
Preparing packages...
ovirt-imageio-common-2.4.3-1.el9.x86_64
Verifying packages...
Preparing packages...
ovirt-imageio-daemon-2.4.3-1.el9.x86_64
INFO: From ImageLayer tools/cdi-func-test-bad-webserver/cdi-func-test-bad-webserver-image-base-layer.tar:
Duplicate file in archive: ./usr/share/licenses/systemd/LICENSE.LGPL2.1, picking first occurrence
INFO: From ImageLayer tools/cdi-func-test-file-host-init/cdi-func-test-file-host-http-image-layer.tar:
Duplicate file in archive: ./etc/nginx/nginx.conf, picking first occurrence
Duplicate file in archive: ./usr/share/licenses/systemd/LICENSE.LGPL2.1, picking first occurrence
INFO: From ImageLayer testimage_base-layer.tar:
Duplicate file in archive: ./usr/share/licenses/systemd/LICENSE.LGPL2.1, picking first occurrence
INFO: From ImageLayer tools/vddk-test/vddk-test-image-layer.tar:
Duplicate file in archive: ./usr/share/licenses/systemd/LICENSE.LGPL2.1, picking first occurrence
INFO: From ImageLayer tools/vddk-init/vddk-init-image-layer.tar:
Duplicate file in archive: ./usr/share/licenses/systemd/LICENSE.LGPL2.1, picking first occurrence
INFO: From ImageLayer tools/cdi-func-test-file-host-init/cdi-func-test-file-host-init-file-image-layer.tar:
Duplicate file in archive: ./usr/share/licenses/systemd/LICENSE.LGPL2.1, picking first occurrence
INFO: From ImageLayer tools/cdi-func-test-proxy/cdi-func-test-proxy-image-base-layer.tar:
Duplicate file in archive: ./usr/share/licenses/systemd/LICENSE.LGPL2.1, picking first occurrence
INFO: From ImageLayer tools/image-io/cdi-func-test-imageio-image-layer.tar:
Duplicate file in archive: ./usr/share/licenses/systemd/LICENSE.LGPL2.1, picking first occurrence
INFO: From ImageLayer tools/cdi-func-test-registry-init/cdi-func-test-registry-populate-image-layer.tar:
Duplicate file in archive: ./usr/share/licenses/systemd/LICENSE.LGPL2.1, picking first occurrence
INFO: From ImageLayer tools/cdi-func-test-sample-populator/cdi-func-test-sample-populator-image-base-layer.tar:
Duplicate file in archive: ./usr/share/licenses/systemd/LICENSE.LGPL2.1, picking first occurrence
INFO: From ImageLayer tools/cdi-func-test-registry-init/cdi-func-test-registry-init-file-image-layer.tar:
Duplicate file in archive: ./usr/share/licenses/systemd/LICENSE.LGPL2.1, picking first occurrence
INFO: Elapsed time: 39.337s, Critical Path: 12.78s
INFO: 177 processes: 51 internal, 126 processwrapper-sandbox.
INFO: Build completed successfully, 177 total actions
akalenyu commented 3 months ago

So make bazel-build-images won't really expose the built images to you, they'll probably just be in bazel cache at that point. You could try something like

DOCKER_PREFIX=ghcr.io/your_repo DOCKER_TAG=some-tag make push