rapidsai / dask-build-environment

Build environments for various dask related projects on gpuCI
4 stars 11 forks source link

Unpin numpy and mlflow in dask-sql env #83

Closed charlesbluca closed 10 months ago

charlesbluca commented 10 months ago

Should unblock failed conda environment solves that started cropping up after https://github.com/dask-contrib/dask-sql/pull/1143

charlesbluca commented 10 months ago

why do you need to unpin them here?

The pinnings in the dask-sql image are meant to make the 3.9 CPU tests double as some form of mindeps testing for some of dask-sql's core dependencies (i.e. make sure things still work with dask 2022.3.0), but since some of them cause conflicts when we try to install alongside the GPU CI deps we unpin those "blocking" dependencies here and concede that the 3.9 GPU tests only run with a limited set of mindeps.

Open to suggestions on other ways we could do this if you have any immediate ideas 🙂 as you've brought up in the past, mindeps testing doesn't account for all the versions in between the minimum and latest, so I'm sure there's a ton of bugs the current setup doesn't account for