Open lithomas1 opened 3 years ago
FTR not all of these options are being targeted on the Arrow side (at least for the time being)
xref discussion in https://github.com/pandas-dev/pandas/issues/23697
@lithomas1 As long as we don't bump the minimum pyarrow version we are really limited what we can support.
Theoretically, we could write a function determining the unsupported actions based on the pyarrow version which is installed. This would allow us to circumvent the minimum pyarrow version if users have a newer pyarrow installed.
@lithomas1 status here?
Sorry for the silence here (forgot to post), planning on updating this list at the very least (some options are deprecated). I'll try to start chipping away at this again this or next week.
Issue tracking Pyarrow engine integration in read_csv (for after #38370 is merged) Current unsupported options
to_pandas
in `read_csv(engine="pyarrow") #34823