MrPowers / mack

Delta Lake helper methods in PySpark
https://mrpowers.github.io/mack/
MIT License
286 stars 42 forks source link

Fix rename function, simplify #126

Closed danielbeach closed 9 months ago

danielbeach commented 9 months ago

@MrPowers I'm not sure what I was thinking in the initial PR, i think it was overcomplicated trying to support both SparkSessions and non-SparkSessions with just DeltaLake standalone reader.

This PR into yours makes it more simple, just a simple SparkSession rename of the DeltaTable. Take a look at the passing Unit Test, do you think this ALTER TABLE NAME will persist past the current SparkSession it's running in?