Given that the schema of a dataframe is retrieved by a simple sql query, when a column is deleted, this column no longer appears in the schema.
In order to be able to display the proper diff in the fields of the dataframe, we go over the diff map and reinsert deleted columns with the proper operation tag and reinsert these columns into the schema object.
Given that the schema of a dataframe is retrieved by a simple sql query, when a column is deleted, this column no longer appears in the schema.
In order to be able to display the proper diff in the fields of the dataframe, we go over the diff map and reinsert deleted columns with the proper operation tag and reinsert these columns into the schema object.