feat: Enable fetching of previously ingested files from minio and S3

ChakshuGautam / cQube-ingestion

cQube Ingestion Blocks

MIT License

5 stars 44 forks source link

Open techsavvyash opened 1 year ago

techsavvyash commented 1 year ago

The aim is to create a service that does the following:

[ ] Fetches the required file from minio/s3/other provider we need to onboard for a given date
[ ] Rename it as per the required conventions for the process it is being used for

techsavvyash commented 1 year ago

Some discussion regarding this went on during the implementation of #101 but the service/adapter to connect to minio/S3 still needs to be developed.