Find the "right" way of applying Polars Expressions

ericpan64 / pydian-canvas-fork

Python framework for developer-friendly data interchange

MIT License

0 stars 0 forks source link

Find the "right" way of applying Polars Expressions #31

Closed ericpan64 closed 2 months ago

ericpan64 commented 10 months ago

Problem

.apply works, however is often slow. Sometimes there are faster ways to do the same thing (e.g. df['col'] // 2 is probably going to be 100x faster than .apply(lambda r: r // 2)

Requested feature

Alternatives considered

Additional context

From viewing this video: https://youtu.be/BBQPeLYpdLY?si=mc0wvs9D3efmNGCF
- Might just need to consider math operations, consider existing partials and making those compatible as well (e.g. apply on the entire column when possible!)

ericpan64 commented 5 months ago

Todo: figure out the "Polars" way of doing this

ericpan64 commented 2 months ago

Closing -- simplify the goal of pydian DataFrames, should just be fore rearranging data! Leave the dataframe operations to a separate step. Don't need to over-complicate now, and can bring back later