Once the EC2 instance and S3 bucket are in the same region, this may not be a concern, since I believe data transfer is free within region.
In the meantime, I've replaced aws s3 cp --recursive with aws s3 sync in analyze-sprint-4.sh, but it doesn't appear to save a significant amount of total data per transfer because most files change each pass.
We may consider updating the results every hour instead.
Once the EC2 instance and S3 bucket are in the same region, this may not be a concern, since I believe data transfer is free within region.
In the meantime, I've replaced
aws s3 cp --recursivewithaws s3 syncinanalyze-sprint-4.sh, but it doesn't appear to save a significant amount of total data per transfer because most files change each pass.We may consider updating the results every hour instead.