Pre-requirements:
A Synapse workspace can be setup to test the reading and iteration from the config file to the pipeline, but later needs to be integrated with the sample in #582
Success criteria:
Ability to read the right configurations and updates to the configuration file from the synapse pipeline. Example: read what are the new files/folders to be ingested or updated in the hierarchy. Write the last ingested time of the data.
Parent #578 Dependency #579
Pre-requirements: A Synapse workspace can be setup to test the reading and iteration from the config file to the pipeline, but later needs to be integrated with the sample in #582
Success criteria: