I can't quite figure out what's going on (the code looks to do the right thing), but I'm leaving a public note because the error is inobvious: For S3 results that come in many parts and take a long time (several minutes), eventually aws will die with 22 and print "403 Forbidden".
I can't quite figure out what's going on (the code looks to do the right thing), but I'm leaving a public note because the error is inobvious: For S3 results that come in many parts and take a long time (several minutes), eventually aws will die with 22 and print "403 Forbidden".
Adding a large --expire-time value fixes it.