Currently, we are only doing basic mocks on individual components.
It would be nice to start doing more integration tests with the mocks and expanding our coverage without requiring us to go to AWS to test everything. A tricky end-to-end integration test would be (all locally):
upload a file to an s3 bucket
Simulate that kicking off batch processing
Run the batch container
Upload the results locally (might be tricky due to the upload url issues, but maybe not as bad as I think if we can mock the environment variable)
Verify that we have a new file
We have simulated most of this individually, or with basic mocks. But I think we could take advantage of moto and mock the entire system out to some extent and verify the coupling of steps together, checking the database records as we go, etc...
Requirements
Starting simple (but still not easy) with s3 already being mocked and needing to integrate with batch.
[ ] Implement mock batch processing
[ ] Upload a file to the mock s3 bucket and verify that it kicks off the batch job as expected
Summary
Currently, we are only doing basic mocks on individual components.
It would be nice to start doing more integration tests with the mocks and expanding our coverage without requiring us to go to AWS to test everything. A tricky end-to-end integration test would be (all locally):
We have simulated most of this individually, or with basic mocks. But I think we could take advantage of moto and mock the entire system out to some extent and verify the coupling of steps together, checking the database records as we go, etc...
Requirements
Starting simple (but still not easy) with s3 already being mocked and needing to integrate with batch.
Related tickets
No response