After #4 is merged we need to remember uploads in the state file and store that file on S3. We do need to think about if we want to support concurrent uploads. I have a feeling this shouldn't be too difficult if we're a bit careful.
Let's start with a simple lockfile, though.
(We could also code the happy path, but let's do concurrent operations right at the start. Fixing this stuff later is difficult because building on invalid assumptions about concurrency is difficult to fix later.)
duijf
commented
5 years ago
After #4 is merged we need to remember uploads in the state file and store that file on S3. We do need to think about if we want to support concurrent uploads. I have a feeling this shouldn't be too difficult if we're a bit careful.
Let's start with a simple lockfile, though.
(We could also code the happy path, but let's do concurrent operations right at the start. Fixing this stuff later is difficult because building on invalid assumptions about concurrency is difficult to fix later.)