dagster-io / dagster-cloud

Unify all your data tools into a productive, enterprise-grade platform.
https://dagster.io/cloud
25 stars 15 forks source link

Docker In Docker support #23

Open josedaniel-escribano-clarity opened 2 months ago

josedaniel-escribano-clarity commented 2 months ago

Hello, we are trying to run dagster-cloud serverless deploy-python-executable inside a vscode devcontainer, pex compilations work fine but when the docker part starts it gives the following error:

Going to deploy location b2c_orchestration
Building Python executable for b2c_orchestration from directory /workspaces/b2c-consumer/src/dagster_orchestration and Python 3.10.
Building project dependencies for Python 3.10, writing to /tmp/tmptm85izj9
Warning: Failed to build dependencies in current environment:ValueError: No pre-built wheel was available for cffi 1.17.1.No pre-built wheel was available for cffi 1.17.1.
Warning: Falling back to build in a docker environment
Running docker ghcr.io/dagster-io/dagster-manylinux-builder:manylinux_2_28_x86_64
Mapped folders:
 - /tmp/tmptm85izj9 -> /output
Error: Failed to build dependencies using docker
Error: docker: Error response from daemon: invalid mount config for type "bind": bind source path does not exist: /host_mnt/private/tmp/tmptm85izj9.
See 'docker run --help'.

We are running it on a macOS Sonoma 14.6.1 and Docker Desktop 4.34.2