In the event of script failure, subsequent runs will start from the beginning and double-upload any progress that had already been made. The resource consumption is probably not a concern but the time lost to a lengthy upload failure may be.
The script should have some approach in place for handling restarts. Either tracking progress and skipping any already-uploaded files, or choosing to skip files that already exist in the bucket. Both approaches could take a flag to ignore them and do a full upload again.
In the event of script failure, subsequent runs will start from the beginning and double-upload any progress that had already been made. The resource consumption is probably not a concern but the time lost to a lengthy upload failure may be.
The script should have some approach in place for handling restarts. Either tracking progress and skipping any already-uploaded files, or choosing to skip files that already exist in the bucket. Both approaches could take a flag to ignore them and do a full upload again.