PeerDB-io / peerdb

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
https://peerdb.io
Other
2.25k stars 92 forks source link

Harp: try modulo uid for clickhouse insertion #1979

Closed Amogh-Bharadwaj closed 3 months ago

Amogh-Bharadwaj commented 3 months ago

As an attempt to get past memory overcommit tracker killing our queries, I'm trying to perform this hotfix of:

SELECT * FROM s3() WHERE mod(toUInt128(toUUID(_peerdb_uid)),17) = x;

Functionally tested