search

voltrondata-labs / arrowbench

R package for benchmarking
Other
13 stars 9 forks source link

Benchmarks for Arrow <-> DuckDB connection #94

Open jonkeane opened 2 years ago

jonkeane commented 2 years ago

Both for pure roundtripping + some filtering on datasets (and tables?)

jonkeane commented 2 years ago

@alistaire47 and @boshek this isn't urgent, but might be something interesting to do + would cover some of our interface

boshek commented 2 years ago

Is the intent here to cover 1) only arrow with datasets, 2) only a duckdb connection and 3) a dataset with a to_duckdb statement somewhere?

jonkeane commented 2 years ago

We already have a limited set of arrow-datasets benchmarks (we always could use some more, of course!)

This would be doing duckdb connections in a few configurations (datasets + arrow tables with to_duckdb() and from_duckdb() and both...)