search

gluent / goe

GOE: a simple and flexible way to copy data from an Oracle Database to Google BigQuery.
Apache License 2.0
8 stars 2 forks source link

Reinstate OFFLOAD_SCN metadata #59

Closed nj1973 closed 9 months ago

nj1973 commented 9 months ago

As part of issue https://github.com/gluent/goe/issues/18 we removed the OFFLOAD_SCN metadata attribute.

In hindsight I think we should have left it in place. There's been talk of the GOE batch data copy tool being able to work in tandem with a CDC tool in the future. For that to be true we ought to continue to capture the start SCN of the offload operation. In truth it may never be used but there's no sense in expending effort erasing it when it "might" be needed.

abb9979 commented 9 months ago

New column OFFLOAD_SNAPSHOT added to repo and interfaces. The Oracle attribute is currently mapped to the Python metadata_dict['OFFLOAD_SCN'] key for consideration when refactoring for Issue 52 (will add a comment there).