Clean up build - Githubissues

dagster-io / hooli-data-eng-pipelines

Example Dagster Cloud code for the Hooli Data Engineering organization.

72 stars 15 forks source link

Closed cnolanminich closed 5 months ago

cnolanminich commented 6 months ago

this PR does a bunch of small things to the build process for the hooli project:

adds uv as the package installer (should ~halve the build time)
remove unused or duplicate python package installations
bumps the python version to 3.11 in the Dockerfile
sets an upper bound in setup.py to <3.12, in part because there are issues loading Dagster on 3.12 that I didn't investigate

github-actions[bot] commented 6 months ago

Your pull request is automatically being deployed to Dagster Cloud.

Location	Link	Updated
demo_assets	View in Cloud	Mar 08, 2024 at 09:23 PM (UTC)
snowflake_insights	View in Cloud	Mar 08, 2024 at 09:23 PM (UTC)
basics	View in Cloud	Mar 08, 2024 at 09:23 PM (UTC)
data-eng-pipeline	View in Cloud	Mar 08, 2024 at 09:23 PM (UTC)
batch_enrichment	View in Cloud	Mar 08, 2024 at 09:23 PM (UTC)