[BUG-REPORT] Export to csv overrides mode and header settings - Githubissues

vaexio / vaex

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀

https://vaex.io

MIT License

8.28k stars 590 forks source link

[BUG-REPORT] Export to csv overrides mode and header settings #2253

Open charvolant opened 1 year ago

charvolant commented 1 year ago

Description

If you supply mode and header keywords to the DataFrame.export_csv method, the code overrides the values when chunking the data at https://github.com/vaexio/vaex/blob/ae00dc165c454a407e3b7f8bf3d31a6987ca2c06/packages/vaex-core/vaex/dataframe.py#L7038

This makes it impossible to append a dataframe onto an existing file.

Software information

Vaex version 4.14.0
Vaex was installed via: pip
OS: OSX 12.6

Additional information

See also https://github.com/vaexio/vaex/issues/1063 and https://github.com/vaexio/vaex/pull/1658

JovanVeljanoski commented 1 year ago

So what do you want to achieve? Do you want to print the header for every chunk?