search

transferwise / pipelinewise-target-redshift

Singer.io Target for Amazon Redshift - PipelineWise compatible
https://transferwise.github.io/pipelinewise/
Other
12 stars 65 forks source link

mysql to redshift datatype mapping for bigint causing overflow error #113

Open Atif8Ted opened 2 years ago

Atif8Ted commented 2 years ago

https://github.com/transferwise/pipelinewise-target-redshift/blob/80796b6c6e4647a85ddc9492e343547a027258e4/target_redshift/db_sync.py#L72

I have a column of datatype bigint(20) in the MySQL database. And this is mapped as numeric(18,0) datatype in Redshift. And this is causing overflow error. We might need to map it to bigint datatype to solve this issue. Similar issue is discussed here : https://github.com/datamill-co/target-redshift/issues/39