search

aws-samples / aws-codecommit-serverless-backup

A serverless solution to back up CodeCommit repositories to S3
MIT No Attribution
47 stars 60 forks source link

Parallelize with GNU Parallel #6

Closed chris-redekop closed 2 years ago

chris-redekop commented 5 years ago

Description of changes:

This reduces run-time and cost by using all cores on the CodeBuild instance while performing the backup. I observe a ~67% reduction in my case.

A retry loop handles rate throttling from CodeCommit.

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

jazzl0ver commented 5 years ago

Works perfectly, thanks @chris-redekop! @hyandell , please, merge it.