Parallel data transfer - Githubissues

reconstrue / cuboids

Cloud-native neuroscientific volumetric cuboids processed over HTTP

http://reconstrue.com

Apache License 2.0

0 stars 0 forks source link

Open JohnTigue opened 4 years ago

JohnTigue commented 4 years ago

[ ] Boss intern or inject
- [ ] Boss Preprint V2 has a note about cuboid based import
[ ] Cuboids Transformer (#26)
[ ] Lamba?

Somehow there needs to be a mechanism by which Transformer is used in a pipeline to transfer a whole lotta image stacks in parallel.

JohnTigue commented 4 years ago

Lamba:

Could it be a StepFunction
Each Lambda input is cell_id plus a plate_list
- In this way multiple Lambdas can work on the same cell in parallel