search

elixir-explorer / explorer

Series (one-dimensional) and dataframes (two-dimensional) for fast and elegant data exploration in Elixir
https://hexdocs.pm/explorer
MIT License
1.12k stars 123 forks source link

[Not Issue] - Are the plans to use duckdb as an alternative backend? #939

Closed kuatroka closed 4 months ago

kuatroka commented 4 months ago

Are the plans to use duckdb as an alternative backend?

I'm using both polars and duckdb in Python and find myself constantly preferring duckdb where possible. Less errors, less data types issues when reading multiple files, faster, deals the out of memory case with grace.

Thanks

josevalim commented 4 months ago

You can use DuckDB via ADBC: https://github.com/elixir-explorer/adbc

Livebook also has some smart cells to get you started.

kuatroka commented 4 months ago

Thanks, I'll check it out. 1st days in the Elixir land