Modify pipeline to ingest new data or update already ingested data based on configuration file

[ydaponte]

Parent #578 Dependency #579 , # 580

Pre-requirements:

580 needs to be done upfront to integrate later with the final sample.

Modify the existing pipeline to ingest or update data lake based on configuration file. The partitioned views also need to be updated accordingly.

Success criteria:

• Synapse pipeline able to ingest and create or update partitioned views based on the configuration file information