onemoredata / bagger

Massive log storage in PostgreSQL
BSD 2-Clause "Simplified" License
12 stars 1 forks source link

Consider Custom logical replication decoder #78

Open einhverfr opened 11 months ago

einhverfr commented 11 months ago

The current replication approach has a significant hardship in that pgoutput is binary-only and therefore we'd have to write a custom parser for that data. The JSON output ones require significant data munging to process. And currently only pgoutput supports publications.

I propose we consider forking the decoded_json plugin, make sure it works on current Postgres versions and add publication support. This may be a relatively quick win for a future version and also produce an open source project e can advertise more generally.