Open petetronic opened 3 months ago
There's some reasoning for this beahvior in the polars docs:
https://docs.pola.rs/user-guide/expressions/missing-data/#notanumber-or-nan-values
Basically, unlike pandas they don't treat NaN's as missing data. It seems like NaN
is the expected behavior for the summary stats here. Note also the %missing is 0. We would want to change the behavior of %missing here too.
Following on from #4307, and the associated fix #4329, we should review how a Polars series of only
np.nan
values should summarize. Our treatment for Polars differs from Pandas:Polars with np.nan series
Pandas with np.nan series