problems with profiling column names with period in name in pyspark

whylabs / whylogs

An open-source data logging library for machine learning models and data pipelines. 📚 Provides visibility into data quality & model performance over time. 🛡️ Supports privacy-preserving data collection, ensuring safety & robustness. 📈

https://whylogs.readthedocs.io/

Apache License 2.0

2.65k stars 121 forks source link

problems with profiling column names with period in name in pyspark #1532

Open jamie256 opened 4 months ago

jamie256 commented 4 months ago

Description

Filing on behalf of report.

column names: "model1.Category", "model1.input_temp" in a dataframe named df:

collect_column_profile_views(df)

-> No column named "model1.Category" error

[ ] I have reviewed the Guidelines for Contributing and the Code of Conduct.

github-actions[bot] commented 1 month ago

This issue is stale. Remove stale label or it will be closed next week.