holgerbrandl / krangl

krangl is a {K}otlin DSL for data w{rangl}ing
MIT License
561 stars 50 forks source link

Consider migrating to apache arrow as backend #133

Open holgerbrandl opened 2 years ago

holgerbrandl commented 2 years ago

See https://arrow.apache.org/docs/java/

Kopilov commented 2 years ago

Hi @holgerbrandl I am going to make Krangl<->Arrow conversion for my customer's project, later in can be embedded to Krangl

holgerbrandl commented 2 years ago

Thanks for sharing. I plan to migrate krangl to use https://github.com/Kotlin/dataframe as backend soon, while preserving most of its additional functionality. In the near future I envision krangl more as a support API on top of kotlin-dataframe. So maybe you could also consider to add arrow support to https://github.com/Kotlin/dataframe instead (fyi @nikitinas)