search

MrPowers / mack

Delta Lake helper methods in PySpark
https://mrpowers.github.io/mack/
MIT License
303 stars 44 forks source link

Is there a way to rename Delta tables #115

Closed MrPowers closed 1 year ago

MrPowers commented 1 year ago

If not, perhaps we can add this functionality

danielbeach commented 1 year ago

@MrPowers Mind if I take on this issue? Seems like an interesting one to solve.

MrPowers commented 1 year ago

@danielbeach - yea, that'd be great, just assigned you to the issue!

danielbeach commented 1 year ago

@MrPowers based on my research renaming a table currently is only supported with delta+spark. Seems like our only option would be to use the write_deltalake with the overwrite option and rename the table at that point. https://delta-io.github.io/delta-rs/python/usage.html#writing-delta-tables , seem like a heavy-handed approach but our only option with the python standalone reader that I can tell.

If you agree let me know and I can implement that.

danielbeach commented 1 year ago

Merged PR, closing issue.