search

letta-ai / letta

Letta (formerly MemGPT) is a framework for creating LLM services with memory.
https://letta.com
Apache License 2.0
12.97k stars 1.42k forks source link

fix: Fix memory summarization #2029

Closed mattzh72 closed 1 week ago

mattzh72 commented 1 week ago

Description:

Fix memory summarization. Memory summarization was broken for models that put inner_thoughts_in_kwargs.

This is because for summarization, we construct a standard user assistant message flow that does not have inner thoughts, function calls, etc. When the LLMConfig requires inner_thoughts_in_kwargs, this causes the assistant message content to be None, which triggers an error on the LLM API.

Testing:

Tested manually via CLI and added a CI test for the live gpt-4o capabilities test.