search

vaexio / vaex

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀
https://vaex.io
MIT License
8.23k stars 590 forks source link

[Question] How to strip blank,new line from data when importing CSV? #2213

Closed lehoai closed 1 year ago

lehoai commented 1 year ago

Hi. I am using vaex.from_csv() to import data but there is no option to strip data. I saw DataFrameLocal has the

df.str.strip()

to strip data but vaex.from_csv() returns Generator instead of DataFrameLocal so cant use str.strip(). Note: my csv data is a very large file so cant strip all data in memory

Please help.