search

MeltanoLabs / target-snowflake

Singer Target for the Snowflake cloud Data Warehouse
https://hub.meltano.com/loaders/target-snowflake--meltanolabs/
Other
9 stars 22 forks source link

Altered Table Column Mismatch #174

Open MrFaircloth opened 5 months ago

MrFaircloth commented 5 months ago

Hello! New to meltano and am running into an odd issue.

On meltano run tap-sftp target-snowflake, running into an issue where a column is inferred as a different data type. Seems to flip between VARCHAR and FLOAT

[2024-04-07, 00:02:22 UTC] name=target_snowflake level=INFO message=Table TAP_SFTP."DESTINATION_TABLE" exists
[2024-04-07, 00:02:22 UTC] name=target_snowflake level=INFO message=Versioning column: ALTER TABLE TAP_SFTP."DESTINATION_TABLE" RENAME COLUMN "COLUM_NAME" TO "COLUMN_NAME_20240407_0002"
[2024-04-07, 00:02:22 UTC] name=target_snowflake level=INFO message=Adding column: ALTER TABLE TAP_SFTP."DESTINATION_TABLE" ADD COLUMN "COLUM_NAME" float

Results in

Number of columns in file (66) does not match that of the corresponding table (67), use file format option error_on_column_count_mismatch=false to ignore this error

Is there a way to specify column types and prevent the column versioning?