Need to think about how to gate the start of the processing lifecycle.
Should probably design for multiple concurrent incoming file streams -- could likely process in parallel, but at some point will need queuing to fall back on if overloaded.
Need some sort of flag to indicate uploads are done and directory is ready for processing.
May want to consider forcing the client to chunk uploads by number of files or total content size or something so we can get started while content is still coming in.
Need to think about how to gate the start of the processing lifecycle.
Should probably design for multiple concurrent incoming file streams -- could likely process in parallel, but at some point will need queuing to fall back on if overloaded.
Need some sort of flag to indicate uploads are done and directory is ready for processing.
May want to consider forcing the client to chunk uploads by number of files or total content size or something so we can get started while content is still coming in.