eakmanrq / sqlframe

Turning PySpark Into a Universal DataFrame API
https://sqlframe.readthedocs.io/en/stable/
MIT License
290 stars 9 forks source link

fix: normalize column names checking for matches #26

Closed eakmanrq closed 4 months ago

eakmanrq commented 4 months ago

Prior to this change if someone provided a column that had mixed case but their engine was case sensitive we wouldn't see this as a duplicate column name to replace the existing one and therefore create a duplicate column. This normalizes the value so the check should be correct now.