search

ddotta / parquetize

R package that allows to convert databases of different formats to parquet format
https://ddotta.github.io/parquetize/
68 stars 4 forks source link

Use a callback function in read_by_chunk() ? #15

Closed ddotta closed 1 year ago

ddotta commented 1 year ago

Arnaud's idea : see if it is possible to use a callback function in read_by_chunk() to be able to write as you go in parquet format instead of storing everything in RAM
@arnaud-feldmann