PeerDB-io / peerdb

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
https://peerdb.io
Other
2.17k stars 88 forks source link

Column Settings #2010

Closed serprex closed 4 weeks ago

serprex commented 1 month ago

For the table box in the UI's table picker for CDC create flow:

Screenshot 2024-08-30 at 2 42 24 AM
serprex commented 1 month ago

custom clickhouse types should only be accepted if matching [a-zA-Z0-9()_,]+

prevents Nested, along with rich JSON, but also prevents unresticted injection

Amogh-Bharadwaj commented 1 month ago

With PEERDB_NULLABLE set, we get the following error when creating the table:

Sorting key contains nullable columns, but merge tree setting `allow_nullable_key` is disabled

Do we want to set allow_nullable_key or exclude the column in ORDER BY if it is Nullable? Or something else

serprex commented 1 month ago

For now we can leave it as unsupported