[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[x] New Connector (Destination or Source Connector)
[ ] Breaking change (fix or feature that would impact existing functionality)
[ ] Styling change
[ ] Documentation update
[ ] Refactoring
[ ] Chore
How Has This Been Tested?
Docker container was created locally and tested the following:
Created S3 as a source connector
Created SFTP as a destination connector
Created S3 source model with SELECT * FROM 's3://ai2-model-staging/scrubbed_ml_leads.parquet';
Created a incremental sync scheduled to run every 2 minutes
Sync executed and all fetched rows were successful.
Checklist:
[ ] Ensure a branch name is prefixed with feature, bugfix, hotfix, release, style or chore followed by / and branch name e.g feature/add-salesforce-connector
[ ] Added unit tests for the changes made (if required)
[ ] Have you made sure the commit messages meets the guidelines?
[ ] Added relevant screenshots for the changes
[ ] Have you tested the changes on local/staging?
[ ] Added the new connector in rollout.rb
[ ] Have you updated the version number of the gem?
[ ] Have you ensured that your changes for new connector are documented in the docs repo or relevant documentation files?
[ ] Have you updated the run time dependency in multiwoven-integrations.gemspec if new gems are added
[ ] Have you made sure the code you have written follows the best practises to the best of your knowledge?
Description
This PR adds Amazon S3 as a new source connector. It also updates the server Gemfile to upgrade the version of multiwove-integrations to 0.2.0.
Related Issue
Relates to issues OSS-2 and BE-197
Type of Change
How Has This Been Tested?
Docker container was created locally and tested the following:
SELECT * FROM 's3://ai2-model-staging/scrubbed_ml_leads.parquet'
;Checklist:
feature
,bugfix
,hotfix
,release
,style
orchore
followed by/
and branch name e.gfeature/add-salesforce-connector