[Feature request] Add support for read_database in Polars backend.

elixir-explorer / explorer

Series (one-dimensional) and dataframes (two-dimensional) for fast and elegant data exploration in Elixir

https://hexdocs.pm/explorer

MIT License

1.12k stars 123 forks source link

[Feature request] Add support for read_database in Polars backend. #877

Closed sweco-semtne closed 8 months ago

sweco-semtne commented 8 months ago

Hi Are there any plans to support the read_database or something similar in the polars_backend to make it possible to create a dataframe from for example kùzu

There seems to be ongoing work to be able to zero copy create a frame from kùzu to polars: https://github.com/pola-rs/polars/pull/14822

It might be the case that it is the wrong level of abstraction to support it in Explorer?

josevalim commented 8 months ago

We are exploring this via the adbc project: https://github.com/elixir-explorer/adbc - so as new databases support via adbc, it should work just with explorer.