search

wesm / pandas2

Design documents and code for the pandas 2.0 effort.
https://pandas-dev.github.io/pandas2/
306 stars 41 forks source link

high performance JSON & NDJson parser #71

Open jreback opened 7 years ago

jreback commented 7 years ago

xref https://github.com/pandas-dev/pandas/issues/9180.

should be able to slot this in as a substitue for pd.read_json before pandas2.

wesm commented 5 years ago

We have developed a parallel line-delimited JSON reader in Apache Arrow, see

https://github.com/apache/arrow/blob/master/python/pyarrow/_json.pyx