search

BurntSushi / xsv

A fast CSV command line toolkit written in Rust.
The Unlicense
10.23k stars 317 forks source link

support unbalanced partitioning #327

Closed bmeck closed 10 months ago

bmeck commented 10 months ago

I have a bunch of streaming output I want to demultiplex and it would be incredibly easy to do so if xsv partition could work with unbalanced CSV rows:

$ cmd | tee foo.csv # generates multiple multiplexed csv dumps
a.csv,1
b.csv,2,3
$ xsv partition --filename '{}' 1 out ./foo.csv
CSV error: record 1 (line: 2, byte: 4): found record with 3 fields, but the previous record has 2 fields
BurntSushi commented 10 months ago

You need to apply xsv fixlengths first. Otherwise every command would need to have its own bespoke handling of CSV data with rows of varying length.