search

dagster-io / dagster

An orchestration platform for the development, production, and observation of data assets.
https://dagster.io
Apache License 2.0
11.72k stars 1.48k forks source link

deploy-python-executable stuck #18200

Open dagsir[bot] opened 12 months ago

dagsir[bot] commented 12 months ago

Issue from the Dagster Slack

This issue was generated from the slack conversation at: https://dagster.slack.com/archives/C02LJ7G0LAZ/p1700593415452679?thread_ts=1700593415.452679&cid=C02LJ7G0LAZ

Conversation excerpt

U06659VR6LE: Hey everyone, having an issue with deploy-python-executable. It gets stuck at this point, and then takes hours to complete:


  --location-name ciro \
  --package-name etl_pipelines \
        --python-version=3.11
Going to deploy location ciro
Building Python executable for ciro from directory /Users/XXXX/etl and Python 3.11.
Building project dependencies for Python 3.11, writing to /var/folders/pj/zxnmgbk523ldprrb4bm9rgbw0000gn/T/tmp5yu67pe7
Warning: Failed to build dependencies in current environment:ValueError: No pre-built wheel was available for pendulum 2.1.2.No pre-built wheel was available for pendulum 2.1.2.
Warning: Falling back to build in a docker environment
Running docker <http://ghcr.io/dagster-io/dagster-manylinux-builder:latest|ghcr.io/dagster-io/dagster-manylinux-builder:latest>
Mapped folders:
 - /var/folders/pj/zxnmgbk523ldprrb4bm9rgbw0000gn/T/tmp5yu67pe7 -&gt; /output```
Please let me know what other information might be helpful to figure out what’s going on, and any help regarding this problem would be greatly appreciated.
U039VKAHCAY: <@U018K0G2Y85> issue deploy-python-executable getting stuck

---

#### Message from the maintainers:

Do you care about this too? Give it a :thumbsup:. We factor engagement into prioritization.
shalabhc commented 12 months ago

This might be a bug in the docker based builder when using Python 3.11. If possible can you please try if this succeeds using --python-version=3.10? I'll investigate the possible issue with 3.11.

yoshig commented 12 months ago

Same issue when running

dagster-cloud serverless deploy-python-executable . \
  --location-name ciro \
  --package-name etl_pipelines \
        --python-version=3.10

Still stuck

mudravrik commented 12 months ago

I believe I faced the same root issue couple treads above. The reason in my case was inability of pip to resolve correct versions of some packages to satisfy all dependencies. You can probably check it if explicitly switch to docker deployment (ENABLE_FAST_DEPLOYS: "false"), which happens anyway looking into the logs. For some reason direct Docker-based run gives more logs from inside the image building process.

As a temporary solution for me, generation of full exact-version requirements.txt by pip-tools ‘pip-compile’ command works quite well. However I’m not quite sure how good this solution is overall since pinning version down to minor one is not the best thing. So I decided to manually check and update most versions to the most recent one of top-level dependencies and switch to 3.11 python to make pip works again.