search

rte-design / ASTRA.ai

ASTRA.ai is an agent framework that supports the creation of real-time multimodal AI Agents. It enables the rapid orchestration and reuse of the latest large model capabilities, achieving low-latency, real-time multimodal interaction with AI Agents.
https://theastra.ai
Apache License 2.0
57 stars 12 forks source link

[Feature Request] add managed worker support for quick deployment as microservices #44

Open plutoless opened 5 days ago

plutoless commented 5 days ago

If the current client application for ASTRA is an HTTP server, it would be ideal to encapsulate the worker management process. Turning it into a microservice or a process pool would simplify the ASTRA client application code and improve quality.

Lensual commented 3 days ago

Just a worker manager or use microservice framework? I'd like to using Kratos. Because I just did RTM2 integration for Kratos Transport, it's helpful.

cyfyifanchen commented 2 days ago

Are there any other options on the market we can consider? Having only one framework choice seems too opinionated, which might not be healthy for maintaining an OSS framework.

cyfyifanchen commented 2 days ago

On second thought, this topic is worth converting into discussion as well.