apache / beam

Apache Beam is a unified programming model for Batch and Streaming data processing.
https://beam.apache.org/
Apache License 2.0
7.89k stars 4.27k forks source link

[Bug]: local-env-setup.sh fails on M1 mac #20983

Open damccorm opened 2 years ago

damccorm commented 2 years ago

When running the start-build-env.sh on my MacBook Air M1, I get the following error:

./start-build-env.sh [+] Building 2.1s (24/24) FINISHED => [internal] load build definition from Dockerfile 0.0s => => transferring dockerfile: 37B 0.0s => [internal] load .dockerignore 0.0s => => transferring context: 2B 0.0s => [internal] load metadata for docker.io/library/ubuntu:20.04 1.9s => [ 1/19] FROM docker.io/library/ubuntu:20.04@sha256:adf73ca014822ad8237623d388cedf4d5346aa72c270c5acc01431cc93e18e2d 0.0s => [internal] load build context 0.0s => => transferring context: 100B 0.0s => CACHED [ 2/19] WORKDIR /root 0.0s => CACHED [ 3/19] RUN echo APT::Install-Recommends "0"; > /etc/apt/apt.conf.d/10disableextras 0.0s => CACHED [ 4/19] RUN echo APT::Install-Suggests "0"; >> /etc/apt/apt.conf.d/10disableextras 0.0s => CACHED [ 5/19] RUN apt -q update && apt install -y software-properties-common apt-utils apt-transport-https ca-certificates && add-apt-repository -y ppa:deadsnakes/ppa 0.0s => CACHED [ 6/19] RUN mkdir /package 0.0s => CACHED [ 7/19] COPY pkglist /package/pkglist 0.0s => CACHED [ 8/19] RUN apt-get -q install -y --no-install-recommends $(grep -v '^#' /package/pkglist | cat) 0.0s => CACHED [ 9/19] RUN sed -i '/en_US.UTF-8/s/^# //g' /etc/locale.gen && locale-gen 0.0s => CACHED [10/19] RUN alias python=python3.6 0.0s => CACHED [11/19] RUN pip3 install grpcio-tools mypy-protobuf virtualenv 0.0s => CACHED [12/19] RUN pip3 install distlib==0.3.1 yapf==0.29.0 pytest 0.0s => CACHED [13/19] RUN wget https://golang.org/dl/go1.12.17.linux-amd64.tar.gz && tar -C /usr/local -xzf go1.12.17.linux-amd64.tar.gz 0.0s => CACHED [14/19] RUN mkdir /scripts 0.0s => CACHED [15/19] COPY beam_env_checks.sh /scripts/beam_env_checks.sh 0.0s => CACHED [16/19] COPY bashcolors.sh /scripts/bashcolors.sh 0.0s => CACHED [17/19] RUN chmod 755 /scripts /scripts/beam_env_checks.sh /scripts/bashcolors.sh 0.0s => CACHED [18/19] RUN echo '. /etc/bash_completion' >> /root/.bash_aliases 0.0s => CACHED [19/19] RUN echo '. /scripts/beam_env_checks.sh' >> /root/.bash_aliases 0.0s => exporting to image 0.0s => => exporting layers 0.0s => => writing image sha256:b74262f57c51bd279b3fcc43190d4edda97cf95055da26eea35e72b40399cd9a 0.0s => => naming to docker.io/library/beam-build 0.0s

Use 'docker scan' to run Snyk tests against images to find vulnerabilities and learn how to fix them Please take a look post-install steps, to manage Docker as non-root user https://docs.docker.com/engine/install/linux-postinstall [+] Building 1.1s (10/11) => [internal] load build definition from Dockerfile 0.0s => => transferring dockerfile: 581B 0.0s => [internal] load .dockerignore 0.0s => => transferring context: 2B 0.0s => [internal] load metadata for docker.io/library/beam-build:latest 0.0s => [1/8] FROM docker.io/library/beam-build 0.0s => CACHED [2/8] RUN rm -f /var/log/faillog /var/log/lastlog 0.0s => CACHED [3/8] RUN groupadd --non-unique -g 100 wouter 0.0s => CACHED [4/8] RUN groupmod -g 1000 docker 0.0s => CACHED [5/8] RUN useradd -g 100 -G docker -u 501 -k /root -m wouter -d "/home/wouter" 0.0s => CACHED [6/8] RUN echo "wouter ALL=NOPASSWD: ALL" > "/etc/sudoers.d/beam-build-501" 0.0s => ERROR [7/8] RUN go get github.com/linkedin/goavro 1.0s ------ > [7/8] RUN go get github.com/linkedin/goavro: #10 1.002 /lib64/ld-linux-x86-64.so.2: No such file or directory ------ executor failed running [/bin/bash -o pipefail -c go get github.com/linkedin/goavro]: exit code: 255

Imported from Jira BEAM-12478. Original Jira may contain additional context. Reported by: wouterb.

Abacn commented 2 years ago

Related to #22742 and could refer to this issue for workaround

gurjarutkarsh commented 11 months ago

The error specifically mentions "/lib64/ld-linux-x86-64.so.2" which might indicate a missing essential library in environment. Error could be related to the Docker container setup or the environment in which the build is being executed