search

domoritz / csv2parquet

Convert CSV files to Apache Parquet.
Apache License 2.0
75 stars 12 forks source link

Combine repos #111

Open domoritz opened 2 years ago

domoritz commented 2 years ago

Combine all the csv/json 2 arrow/parquet repos. Maybe using something like the approach in https://github.com/vega/vl-convert.

mrhrzg commented 1 year ago

A refactoring like in https://github.com/vega/vl-convert where the CLI binary code (i.e., vl-convert) is separate from the lib (i.e., vl-convert-rs) would allow to use csv2parquet as a dependency for another crate.

domoritz commented 1 year ago

Yes, that would simplify development a lot. The one remaining question for me is how automatic deployments with releases can work. Would we have one release for all packages or separate release scripts? How will they get triggered?