Docker image build failing for latest master branch

[sumanthssr]

=> CACHED [server 4/5] WORKDIR /home/app/server/ 0.0s => CANCELED [server 5/5] RUN ./gradlew build -x test -PSPARK_VERSION=3.5.0 1.3s => ERROR [frontend 4/6] RUN wget "https://downloads.apache.org/spark/spark-3.5.0/spark-3.5.0-bin-hadoop3.tgz" -O - | tar -xz

Is there any working branch to build custom lighter image? @Minutis

[pdambrauskas]

you should be able to build on https://github.com/exacaster/lighter/pull/908

[sumanthssr]

@pdambrauskas seeing jar not found issue after 3.5.1 changes

Building 0.8s (23/29)                                                                                                                       docker:default
load build definition from Dockerfile                                                                                                      0.0s
transferring dockerfile: 2.08kB                                                                                                                    0.0s
load metadata for docker.io/library/eclipse-temurin:17-jdk-jammy                                                                           0.6s
load metadata for docker.io/library/node:lts-alpine3.18                                                                                    0.6s
load metadata for docker.io/library/eclipse-temurin:17-jre-jammy                                                                           0.6s
load .dockerignore                                                                                                                         0.0s
transferring context: 2B                                                                                                                           0.0s

=> [server 1/5] FROM docker.io/library/eclipse-temurin:17-jdk-jammy@sha256:fff4a27c817ab1e215bdbd8d3105703c2fb2b5af32cf215de67e383be3fadcc6 0.0s => [internal] load build context 0.0s => => transferring context: 17.20kB 0.0s => [frontend 1/6] FROM docker.io/library/node:lts-alpine3.18@sha256:a02826c7340c37a29179152723190bcc3044f933c925f3c2d78abb20f794de3f 0.0s => [stage-2 1/12] FROM docker.io/library/eclipse-temurin:17-jre-jammy@sha256:f8fcee3a0659c2d166e823f8b3ee0d6c3926c871aff78f8b59407d018f1af083 0.0s => CACHED [stage-2 2/12] RUN ln -s /etc/hadoop/conf.cloudera.yarn /etc/alternatives/hadoop-conf && ln -s /etc/hive/conf.cloudera.hive /etc/alternati 0.0s => CACHED [stage-2 3/12] WORKDIR /home/app/ 0.0s => CACHED [frontend 2/6] WORKDIR /home/app/ 0.0s => CACHED [frontend 3/6] COPY frontend/ ./frontend/ 0.0s => CACHED [frontend 4/6] RUN wget "https://downloads.apache.org/spark/spark-3.5.1/spark-3.5.1-bin-hadoop3.tgz" -O - | tar -xz 0.0s => CACHED [frontend 5/6] WORKDIR /home/app/frontend/ 0.0s => CACHED [frontend 6/6] RUN yarn install && yarn build 0.0s => CACHED [server 2/5] WORKDIR /home/app/ 0.0s => CACHED [server 3/5] COPY server/ ./server/ 0.0s => CACHED [server 4/5] WORKDIR /home/app/server/ 0.0s => CACHED [server 5/5] RUN ./gradlew build -x test -PSPARK_VERSION=3.5.1 0.0s => CACHED [stage-2 4/12] COPY --from=server /home/app/server/build/docker/main/layers/libs /home/app/libs 0.0s => CACHED [stage-2 5/12] COPY --from=server /home/app/server/build/docker/main/layers/resources /home/app/resources 0.0s => ERROR [stage-2 6/12] COPY --from=server /home/app/server/build/docker/main/layers/application.jar /home/app/application.jar 0.0s

[stage-2 6/12] COPY --from=server /home/app/server/build/docker/main/layers/application.jar /home/app/application.jar:

Dockerfile:41

39 | COPY --from=server /home/app/server/build/docker/main/layers/libs /home/app/libs 40 | COPY --from=server /home/app/server/build/docker/main/layers/resources /home/app/resources 41 | >>> COPY --from=server /home/app/server/build/docker/main/layers/application.jar /home/app/application.jar 42 |
43 | COPY --from=frontend /home/app/frontend/dist/ ./frontend/

ERROR: failed to solve: failed to compute cache key: failed to calculate checksum of ref 62b26a71-83a4-4925-a4d9-3c8c889bc9fb::q415gvzkubco8b354tnysc3z5: "/home/app/server/build/docker/main/layers/application.jar": not found

[pdambrauskas]

Hm, strange, I’ll look into it a bit later.

[pdambrauskas]

I've fixed Docker file on https://github.com/exacaster/lighter/pull/908. It was failing because of framework update, after which artefact was built under a different path.