Updated DMSCDC_CloudTemplate_Reusable.yaml logging for better error visibility.
Updated DMSCDC_CloudTemplate_Source.yaml, removing unnecessary condition and allowing wildcard schema filter. Also removed optional from parameters, as they are required due to the way the code handles them.
Updated DMSCDC_Controller.py to support traversing S3 directories recursively to enable wildcard schema filter. Removed optional parameter handling, as it still resulted in an error when not supplied. Updated single ActiveFlag check to surround both initial and incremental file processing logic, rather than both separately.
Updated DMSCDC_SampleDB_Initial.sql to match SQL from README.
Updated README.md with new code and explanations from changes to DMSCDC_Controller.py.
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.
Issue #, if available: n/a
Description of changes: Made following updates:
DMSCDC_CloudTemplate_Reusable.yaml
logging for better error visibility.DMSCDC_CloudTemplate_Source.yaml
, removing unnecessary condition and allowing wildcard schema filter. Also removed optional from parameters, as they are required due to the way the code handles them.DMSCDC_Controller.py
to support traversing S3 directories recursively to enable wildcard schema filter. Removed optional parameter handling, as it still resulted in an error when not supplied. Updated singleActiveFlag
check to surround both initial and incremental file processing logic, rather than both separately.DMSCDC_SampleDB_Initial.sql
to match SQL from README.README.md
with new code and explanations from changes toDMSCDC_Controller.py
.By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.