Data streams for functions

[brianneisler]

This is a Feature Request

Description

It would be super convenient to be able to introduce streams to serverless functions so that you could stream in large data files during a single function invocation. It's challenging to do this currently because not all serverless function providers support data streams.

Use-cases

• Stream large files to a function during a single invocation

Concepts

• event gateway receives an upload stream
• event gateway invokes a function and gives it a stream id
• function opens a backward request to the gateway to open a stream with the gateway
• event-gateway streams data to function

[mthenw]

@brianneisler how would you deal with invocation duration limit?

[brianneisler]

@mthenw can't really get around that limit. This is just to get around the payload size limit on providers.