pydiverse / pydiverse.pipedag

A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.

https://pydiversepipedag.readthedocs.io/

BSD 3-Clause "New" or "Revised" License

15 stars 2 forks source link

Use `polars-lts-cpu` instead of `polars` for x86_64 OS X #135

Closed nicolasmueller closed 5 months ago

nicolasmueller commented 6 months ago

When running pipedag on OS X with rosetta (i.e. x86_64 emulation), the polars import crashes since it assumes the existence of some CPU instructions not available in the emulator. Importing polars-lts-cpu instead in this case fixes the problem.

Checklist

[x] Added a docs/source/changelog.md entry

windiana42 commented 5 months ago

The poetry.lock file should already be checked by unit tests for Linux. I tested the change here on my machine once more including poetry lock and also found no issue.