Feat: better support for JSON i/o

vaexio / vaex

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀

https://vaex.io

MIT License

8.23k stars 590 forks source link

Open JovanVeljanoski opened 1 year ago

JovanVeljanoski commented 1 year ago

This PR does:

[x] Implement new vaex.from_json_arrow method that is significantly faster way of reading JSON records
[x] df.export_json() now accepts "backend" and "lines" arguments.
[x] Unit-test that tests all of the above features
[ ] Review

To-Do (to be handled in a separate PR):