search

PeerDB-io / peerdb

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
https://peerdb.io
Other
2.17k stars 88 forks source link

Clickhouse: nullable fix for normalize in CDC #2106

Closed Amogh-Bharadwaj closed 5 days ago

Amogh-Bharadwaj commented 5 days ago

We need to specify Nullable when specifying the type argument of JSONExtract, else it will convert to default

Screenshot 2024-09-26 at 7 05 09 PM

iskakaushik commented 5 days ago

@serprex can you file an issue to add an end-to-end test for nullability on ClickHouse please and take it up as a priority item? Covering both CDC and initial load.

iskakaushik commented 5 days ago

lets include more common nullable types in the test. Thanks for the test @serprex -- the ones that @Amogh-Bharadwaj covered in a4d27da