Closed aajisaka closed 5 months ago
@aajisaka Thank you for your feature submission. We are currently reviewing this feature.
@aajisaka We have confirmed this is a bug and will address this in an upcoming release.
Thank you @aajisaka for submitting a fix for this issue. I am merging this into the mainline and it will be part of the next release.
Now the connector creates Redshift table with
INTEGER
column if the DataFrame column is short. After this change, the connector createsSMALLINT
column.Note that this change will change the behavior if the DataFrame has ShortType column
The issue was opened long time ago https://github.com/databricks/spark-redshift/issues/401 but not fixed