ubc-cirrus-lab / caribou

Caribou is a framework for running and deploying complex serverless workflows multi-constraint and multi-objective aware on hyper-scalers over multiple regions.
Other
6 stars 0 forks source link

Implement Component Interactions #304

Open Danidite opened 4 weeks ago

Danidite commented 4 weeks ago

Define component interactions (messages), specifically when and how a component triggers another. This is particularly relevant regarding the log syncer, which should spawn child serverless functions to handle different workflows; the manage_deployment, which should spawn separate solver instances for any deployment that requires deployment solving; and finally, the deployment migrator, which can spawn new instances if it needs to handle too many migrations.

These changes will be especially helpful in avoiding AWS Lambda's 15-minute maximum runtime restriction per function invocation and in increasing parallelism.