livekit / agents

Build real-time multimodal AI applications 🤖🎙️📹
https://docs.livekit.io/agents
Apache License 2.0
3.92k stars 396 forks source link

Container / Deployment / Autoscaling Suggestions? #686

Closed willsmanley closed 1 week ago

willsmanley commented 2 months ago

Has anyone measured cpu/ram requirements for the minimal example?

Anyone done load testing or have recommendations for autoscaling plan?

It'd be good to also know where the sweet spot is: fewer beefy machines with lots of jobs each vs. more lighter machines with fewer jobs each.

I'm going to start testing and will provide any updates here. I believe 2gb ram is minimum required to run a single job.

keepingitneil commented 1 month ago

Definitely interested to see your results 🙏 I'm will be writing a best-practices guide soon and had similar plans to do this kind of benchmarking

firattamurlc commented 1 month ago

Hello, are there any update or recommendations for this ? Thank you : )

Kedaqusa1604 commented 1 week ago

Hi. Any updates on this? Thanks in advance

davidzhao commented 1 week ago

we've got some deployment docs up now: https://docs.livekit.io/agents/deployment/

as well as example configurations for Fly and ECS: https://github.com/livekit-examples/agent-deployment