search

pathwaycom / pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.
https://pathway.com
Other
2.84k stars 98 forks source link

[Bug]: Slow pip dependencies - wheels building for python-sat and others #26

Closed dxtrous closed 3 months ago

dxtrous commented 3 months ago

Steps to reproduce

Today, fresh Pathway installations from pip are taking rather long minutes rather than the usual 35 seconds (Colab timings). I would propose to fix this as a priority.

Relevant log output

Pip takes most time on: `Building wheels for collected packages: python-sat`.

What did you expect to happen?

No wheels built from sources

Version

0.8.4

Docker Versions (if used)

No response

OS

Linux

On which CPU architecture did you run Pathway?

None

embe-pw commented 3 months ago

This usually happens just after a new release, when the wheels are not yet built. Usually resolves itself in around a day. We usually pass --prefer-binary to pip install so that versions with wheels missing are skipped.

dxtrous commented 3 months ago

Thanks @embe-pw. @olruas in that case perhaps we could change model instructions for Colab at least to --prefer-binary, wdyt?

olruas commented 3 months ago

Good idea @dxtrous.

olruas commented 3 months ago

The change is done: the notebooks now have the --prefer-binary option and the installation is back to something similar to what we had before.