[Python] Support pandas future default string dtype

apache / arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

https://arrow.apache.org/

Apache License 2.0

14.53k stars 3.54k forks source link

[Python] Support pandas future default string dtype #43683

Open jorisvandenbossche opened 2 months ago

jorisvandenbossche commented 2 months ago

With pandas' PDEP-14 proposal, pandas is planning to introduce a default string dtype in pandas 3.0 (instead of the current object dtype).

This will become the default in pandas 3.0, and can be enabled with an option in the upcoming pandas 2.3 (pd.options.future.infer_string = True). To prepare for that, we should start using that string dtype in to_pandas() conversions when that option is enabled.

raulcd commented 3 weeks ago

@jorisvandenbossche should I move this to 19.0.0?