microsoft / lida

Automatic Generation of Visualizations and Infographics using Large Language Models
https://microsoft.github.io/lida/
MIT License
2.6k stars 266 forks source link

Single User functionality #75

Open HediehM opened 7 months ago

HediehM commented 7 months ago

To my understanding, LIDA functions as a single-threaded application, serving one user per session. We’re exploring scaling LIDA to an enterprise level, enabling multi-user support simultaneously.

Does Microsoft offer any existing frameworks or solutions to transition LIDA from single-threaded to multi-threaded architecture?

Furthermore, as we plan to use Azure Redis Cache Services, how would this scaling impact our caching strategy? Are there established solutions for managing cache effectively in a multi-user, multi-threaded environment?

What other information regarding this topic you can provide which can help us to design a solution.