Open dagsir[bot] opened 12 months ago
This might be a bug in the docker based builder when using Python 3.11. If possible can you please try if this succeeds using --python-version=3.10
?
I'll investigate the possible issue with 3.11.
Same issue when running
dagster-cloud serverless deploy-python-executable . \
--location-name ciro \
--package-name etl_pipelines \
--python-version=3.10
Still stuck
I believe I faced the same root issue couple treads above. The reason in my case was inability of pip to resolve correct versions of some packages to satisfy all dependencies.
You can probably check it if explicitly switch to docker deployment (ENABLE_FAST_DEPLOYS: "false"),
which happens anyway looking into the logs. For some reason direct Docker-based run gives more logs from inside the image building process.
As a temporary solution for me, generation of full exact-version requirements.txt by pip-tools ‘pip-compile’ command works quite well. However I’m not quite sure how good this solution is overall since pinning version down to minor one is not the best thing. So I decided to manually check and update most versions to the most recent one of top-level dependencies and switch to 3.11 python to make pip works again.
Issue from the Dagster Slack
This issue was generated from the slack conversation at: https://dagster.slack.com/archives/C02LJ7G0LAZ/p1700593415452679?thread_ts=1700593415.452679&cid=C02LJ7G0LAZ
Conversation excerpt
U06659VR6LE: Hey everyone, having an issue with deploy-python-executable. It gets stuck at this point, and then takes hours to complete: