AlexsLemonade / refinebio

Refine.bio harmonizes petabytes of publicly available biological data into ready-to-use datasets for cancer researchers and AI/ML scientists.
https://www.refine.bio/
Other
126 stars 19 forks source link

Find a way to export Docker cache properly #3293

Closed arkid15r closed 1 year ago

arkid15r commented 1 year ago

Context

While working on docker scripts and CI/CD jobs optimization I found out that GH docker driver (default) doesn't support cache export we want to utilize.

Problem or idea

ERROR: cache export feature is currently not supported for docker driver. Please switch to a different driver (eg. "docker buildx create --use")

Solution or next step

The issue may become irrelevant after introduction of a remote docker builder.

arkid15r commented 1 year ago

Fixed by using different builder type:

DOCKER_BUILDER="refinebio_local_builder"
docker buildx create \
    --driver=docker-container \
    --name="$DOCKER_BUILDER" \
    --platform=linux/amd64 2>/dev/null ||
    true