search

rcongiu / Hive-JSON-Serde

Read - Write JSON SerDe for Apache Hive.
Other
733 stars 391 forks source link

Possible to have 'alternative' mappings for columns for legacy data? #206

Open djhworld opened 6 years ago

djhworld commented 6 years ago

Say I have the following table

window string

and at some point I want to rename window because the process that it outputting data to my data lake has started calling this column timewindow

I can rename the column in HIVE to be timewindow but now all the 'legacy' data that we've been ingesting in the data lake before the change still has the column window

Is there a mapping/method/way in the SerDe of saying that on read any data with the column name window should be mapped to timewindow?

Or do I need to do a batch post process of all the data to correct it?