databricks / koalas

Koalas: pandas API on Apache Spark
Apache License 2.0
3.32k stars 356 forks source link

Spammed with FutureWarnings that are unfilterable #2224

Open CodyGreen-Datavant opened 1 year ago

CodyGreen-Datavant commented 1 year ago

When preforming any kind of itterable: enc[example'] = enc.example.apply(lambda x: 1880 if pd.notnull(x) & ((x >=1880) & (x < 1890)) else x)

I am constantly spammed with:

/path/miniconda/lib/python3.8/site-packages/pyspark/python/lib/pyspark.zip/pyspark/pandas/internal.py:1573: FutureWarning: iteritems is deprecated and will be removed in a future version. Use .items instead.

I believe this is due to the new pandas update.