search

kindly / flatterer

Opinionated JSON to CSV/XLSX/SQLITE/PARQUET converter. Flattens JSON fast.
https://flatterer.opendata.coop
MIT License
180 stars 7 forks source link

What is "simple flattening"? #40

Closed jpmckinney closed 1 year ago

jpmckinney commented 1 year ago

It hasn't been added to docs (that I can find): https://github.com/kindly/libflatterer/commit/0cb29a93251897dc9f386ad674aa3bc50d64ac54

Opening here rather than libflatterer, as I was told last time that libflatterer isn't monitored.

kindly commented 1 year ago

It is just a way of flattening without any threads. It should probably be private, or just part of the test module, as it lowers performance, but makes it easier to test the performance impact of changes. Having threads, sometimes, makes it hard to work out where the bottlenecks are. There are no python bindings yet either, and am not sure if there will be, which is why it is not added to the changelog.

jpmckinney commented 1 year ago

Thanks!