Implement SQS-based communication

spcl / fmi

Function Message Interface (FMI): library for message-passing and collective communication for serverless functions.

https://mcopik.github.io/projects/fmi/

13 stars 10 forks source link

Implement SQS-based communication #1

Open mcopik opened 1 year ago

mcopik commented 1 year ago

One communication channel we have yet to cover so far is AWS SQS. We could use it to communicate between functions, with the main limitation being the low message size (256 kB) and the need for base64 encoding.

Steps for the solution:

[ ] Allocate the SQS client and select a proper queue.
[ ] Implement a new indirect channel.
[ ] Implement splitting serialized data across multiple packets.
[ ] Add tests covering the new communication method.

whiz-Tuhin commented 5 months ago

Hi @mcopik, I am going through the FMI paper and your thesis and am interested in contributing to this project. Should I get started on this issue ?

mcopik commented 5 months ago

@whiz-Tuhin yes, please :-) Implementing SQS using existing interfaces should be straightforward.

Let me know if you have any questions!