search

vaexio / vaex

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
https://vaex.io
MIT License
8.23k stars 590 forks source link

Complete documentation for vaex.open_many() #2241

Open joseberlines opened 1 year ago

joseberlines commented 1 year ago

Having a look to the documentation API for vaex.open_many I dont see a way to really know what kind of files vaex expects.

https://vaex.readthedocs.io/en/latest/_modules/vaex.html#open_many

Nor in issue #2158 its clear to me that the list of paths have to be vaex dataframes saved in hdf5 format.

JovanVeljanoski commented 1 year ago

The files can be in any format that vaex open method supports: hdf5, arrow, parquet, csv. I will try to add this to the docstring to make it more clear.