search

linkedin / databus

Source-agnostic distributed change data capture system
Apache License 2.0
3.64k stars 735 forks source link

How could I do the base and increament through databus? #41

Closed hopecheng closed 9 years ago

hopecheng commented 10 years ago

I now use databus to catch the changes of mysql. Now I meet one problem: Every day my DBA will backup the DB, and once we need to rebuild the data, we could do it from the lastest day. But I don't know where to start the offset since databus always from the last point. Could I save the point at some time every day? Or databus has the feature to do so?

Thanks Hopecheng

chavdar commented 10 years ago

By default, the relay persists the last processed SCN in a text file. The format of the file is:

: The date is used purely for debugging purposes. The configuration of the directory and file name to use for storing the SCN are controlled by the following configuration properties: - dataSources.sequenceNumbersHandler.type=FILE (default) - dataSources.sequenceNumbersHandler.file.scnDir (default is "./databus2-maxscn) - dataSources.sequenceNumbersHandler.file.key= (default is "MaxSCN_" + name of the physical source) On Fri, Sep 26, 2014 at 1:47 AM, hopecheng notifications@github.com wrote: > I now use databus to catch the changes of mysql. Now I meet one problem: > Every day my DBA will backup the DB, and once we need to rebuild the data, > we could do it from the lastest day. But I don't know where to start the > offset since databus always from the last point. Could I save the point at > some time every day? Or databus has the feature to do so? > > Thanks > Hopecheng > > — > Reply to this email directly or view it on GitHub > https://github.com/linkedin/databus/issues/41.