Description
ArrowInvalid: Failed casting from large_string to string
Code: vaex.from_csv("/data/transactions.csv",convert=True,chunk_size=10000000)
When I tried to call the from_csv function to convert the csv file to hdf5, each small hdf5 file was generated smoothly, but when aggregating each small file, an error occurred. I suspect if some of my fields are too long for vaex compatibility.
Description ArrowInvalid: Failed casting from large_string to string Code: vaex.from_csv("/data/transactions.csv",convert=True,chunk_size=10000000) When I tried to call the from_csv function to convert the csv file to hdf5, each small hdf5 file was generated smoothly, but when aggregating each small file, an error occurred. I suspect if some of my fields are too long for vaex compatibility.
Software information
Vaex version (
import vaex; vaex.__version__)
: {'vaex-core': '4.12.0', 'vaex-viz': '0.5.3', 'vaex-hdf5': '0.12.3', 'vaex-server': '0.8.1', 'vaex-astro': '0.9.1', 'vaex-jupyter': '0.8.0', 'vaex-ml': '0.18.0'}Vaex was installed via: conda-forge
OS: Ubuntu LTS 20.04
Additional information