pola-rs / pyo3-polars

Plugins/extension for Polars
MIT License
238 stars 39 forks source link

Remove pyarrow from `derive_expression` requirements #33

Closed MarcoGorelli closed 11 months ago

MarcoGorelli commented 11 months ago

Is pyarrow necessary here?

At least, I don't have it installed, but I got this running fine (I think?)

(.venv) marcogorelli@DESKTOP-U8OKFP3:~/py03-polars-dev/example/derive_expression$ python -c 'import pyarrow'
Traceback (most recent call last):P3:~/py03-polars-dev/example/derive_expression$
  File "<string>", line 1, in <module>
ModuleNotFoundError: No module named 'pyarrow'
(.venv) marcogorelli@DESKTOP-U8OKFP3:~/py03-polars-dev/example/derive_expression$ python run.py
shape: (3, 9)
┌─────────┬───────┬─────────────┬───────────────┬───┬───────────┬──────────────┬─────────────┬───────────┐
│ names   ┆ moons ┆ dist_a      ┆ dist_b        ┆ … ┆ pig_latin ┆ hamming_dist ┆ jaccard_sim ┆ haversine │
│ ---     ┆ ---   ┆ ---         ┆ ---           ┆   ┆ ---       ┆ ---          ┆ ---         ┆ ---       │
│ str     ┆ str   ┆ list[i64]   ┆ list[i64]     ┆   ┆ str       ┆ u32          ┆ f64         ┆ f64       │
╞═════════╪═══════╪═════════════╪═══════════════╪═══╪═══════════╪══════════════╪═════════════╪═══════════╡
│ Richard ┆ full  ┆ [12, 32, 1] ┆ [-12, 1]      ┆ … ┆ ichardRay ┆ 22           ┆ 0.25        ┆ 0.0       │
│ Alice   ┆ half  ┆ []          ┆ [43]          ┆ … ┆ liceAay   ┆ 12           ┆ 0.0         ┆ 0.0       │
│ Bob     ┆ red   ┆ [1, -2]     ┆ [876, -45, 9] ┆ … ┆ obBay     ┆ 8            ┆ 0.0         ┆ 0.0       │
└─────────┴───────┴─────────────┴───────────────┴───┴───────────┴──────────────┴─────────────┴───────────┘

It might be necessary for [extend_polars_python_dispatch](https://github.com/pola-rs/pyo3-polars/tree/main/example/extend_polars_python_dispatch), but that has its own requirements file

ritchie46 commented 11 months ago

No certainly not. Thanks!