attic-labs / noms

The versioned, forkable, syncable database
Apache License 2.0
7.45k stars 266 forks source link

`csv-invert` command line tool #3689

Closed cmasone-attic closed 6 years ago

cmasone-attic commented 6 years ago

Takes the output of a CSV file imported as a List of Struct and "inverts" it so that it's now a Struct of Lists.

Example:

List<Struct Row { Base?: String, DOLocationID?: String, }>

becomes

Struct Columnar { base: List, dolocationid: List, }

cmasone-attic commented 6 years ago

Takes about 6 mins to invert ~1GB of imported CSV data here on my lappytop

If we think that's fast enough for right now, then PTAL

cmasone-attic commented 6 years ago

ok, @ehalpern PTAL

cmasone-attic commented 6 years ago

Ok, PTAL