search

letta-ai / letta

Letta (formerly MemGPT) is a framework for creating LLM services with memory.
https://letta.com
Apache License 2.0
12.14k stars 1.34k forks source link

Not a bug #1461

Open stevenbaert opened 4 months ago

stevenbaert commented 4 months ago

Hi,

To clarify: not a bug, just a general question. Feel free to delete afterwards /point me to correct destination for such questions.

I've been following your project for quite some time now and really love what you're doing. However, I've never fully committed to using it due to some issues with speed and a lack of certain features.

My question is: has the project reached a level of maturity and speed that would allow it to be used as a daily driver for myself and my colleagues at work? Ideally, I'm looking for response times and functionalities similar to GPT-4, possibly using Groq, with voice capabilities, a web interface, and, of course, extensive memory.

Is this something that's feasible?

Thanks!

sarahwooders commented 4 months ago

Thanks for following the project! We have support for a lot of the things you mentioned (or will soon):

To be completely honest, we are still in the process of improving stability and fixing bugs, so you may face issues with trying these things, so might want to wait a few weeks if you want think to just work. But if you try things sooner, we can also try to prioritize the bugs/features that are important to your use case :)

stevenbaert commented 4 months ago

Thanks for following the project! We have support for a lot of the things you mentioned (or will soon):

  • We added support for Groq recently, but it hasn't been extensively tested so may have issues.
  • We are working on integrating with Vapi by supporting streaming chat competitions https://github.com/cpacker/MemGPT/pull/1280
  • We have a web interface coupled with the server -- you can see the instructions for setting up the dev portal UI in the README (probably with docker is the easiest)

To be completely honest, we are still in the process of improving stability and fixing bugs, so you may face issues with trying these things, so might want to wait a few weeks if you want think to just work. But if you try things sooner, we can also try to prioritize the bugs/features that are important to your use case :)

Thanks for your feedback, but it surprises me. This project is there for more than a year, right? So still no stable version then?

cpacker commented 4 months ago

Thanks for your feedback, but it surprises me. This project is there for more than a year, right? So still no stable version then?

The project was originally released in October (so ~8 months ago), but it's evolved a lot over time: initially it was just a CLI tool to experiment with the concept of self-editing memory + LLMs (an implementation of an LLM OS as described in the MemGPT research paper), then at the beginning of this year we began expanding the repo to support building LLM applications on top of a MemGPT-backed REST API (so going from a CLI tool to a service). This redesign has taken a few months since the core contributors (@sarahwooders and I) were finishing our PhDs at the same time, but now that the PhDs are done you can expect the pace of development to significantly increase - we're targeting a stable production build on the server ready this summer. If you have any particular feature requests please let us know, we're happy to adjust the immediate roadmap based on user feedback. And thanks so much for following the project!

stevenbaert commented 3 months ago

Would appreciate a status update a lot in order to understand current situation (iow is it ready for production now?). Thanks!