I've imported the "spark_df_profiling" library, and when calling the ProfileReport I get an error (using python 3.7):
Call:
import spark_df_profiling as spkdfprof
resProfiling = spkdfprof.ProfileReport(df)
Messages:
/databricks/python/lib/python3.7/site-packages/pyarrow/init.py:152: UserWarning: pyarrow.open_stream is deprecated, please use pyarrow.ipc.open_stream
warnings.warn("pyarrow.open_stream is deprecated, please use "
/databricks/python/lib/python3.7/site-packages/pyarrow/init.py:152: UserWarning: pyarrow.open_stream is deprecated, please use pyarrow.ipc.open_stream
warnings.warn("pyarrow.open_stream is deprecated, please use "
/databricks/python/lib/python3.7/site-packages/pyarrow/init.py:152: UserWarning: pyarrow.open_stream is deprecated, please use pyarrow.ipc.open_stream
warnings.warn("pyarrow.open_stream is deprecated, please use "
AttributeError: module 'pandas' has no attribute 'tslib'
Hi,
I've imported the "spark_df_profiling" library, and when calling the ProfileReport I get an error (using python 3.7): Call:
import spark_df_profiling as spkdfprof
resProfiling = spkdfprof.ProfileReport(df)
Messages:
/databricks/python/lib/python3.7/site-packages/pyarrow/init.py:152: UserWarning: pyarrow.open_stream is deprecated, please use pyarrow.ipc.open_stream warnings.warn("pyarrow.open_stream is deprecated, please use " /databricks/python/lib/python3.7/site-packages/pyarrow/init.py:152: UserWarning: pyarrow.open_stream is deprecated, please use pyarrow.ipc.open_stream warnings.warn("pyarrow.open_stream is deprecated, please use " /databricks/python/lib/python3.7/site-packages/pyarrow/init.py:152: UserWarning: pyarrow.open_stream is deprecated, please use pyarrow.ipc.open_stream warnings.warn("pyarrow.open_stream is deprecated, please use "
AttributeError: module 'pandas' has no attribute 'tslib'
Thanks! Kr, Egon