search

getdozer / dozer

Dozer is a real-time data movement tool that leverages CDC from various sources and moves data into various sinks.
https://getdozer.io
GNU Affero General Public License v3.0
1.49k stars 121 forks source link

Remove record-store #2385

Closed MG190202 closed 7 months ago

MG190202 commented 8 months ago

For adding record-store changes- remove it and its usage

MG190202 commented 8 months ago

It has got multiple usages in :

  1. dozer-cli
  2. dozer-sink-aerospace
  3. dozer-sink-clickhouse
  4. dozer-sink-oracle
  5. dozer-tests
  6. dozer-sql
  7. dozer-core

Starting off with the first four-> For dozer-cli -> It has 2 uses in dozer-cli -> in pipeline/dummysink and in pipeline/log_sink, should i remove its usage completely from these 2 files as i dont know about the usage of DummySink and LogSink? ProcessorRecordStore is being used. For dozer-sink-* It has multiple uses for the AerospikeSink, ClickhouseSink and OracleSink. ProcessorRecordStore is being used. What to do about them?

chubei commented 8 months ago

I think all usage can be removed?

MG190202 commented 8 months ago

I think all usage can be removed?

Yes, i have removed most of it, only some things are left like RecordStore enum