search

letta-ai / letta

Letta (formerly MemGPT) is a framework for creating LLM services with memory.
https://letta.com
Apache License 2.0
12.88k stars 1.41k forks source link

Context window is not read in anthropic and summarize is not working #2044

Open Sapessii opened 6 days ago

Sapessii commented 6 days ago

Describe the bug Even setting the context window, the summarize function is not called.

I think this happens because "summarize_messages_inplace" is called only when the llm returns error, but claude has 200k, it will take a lot to reach it

And when manually called throws error in anthropic.py here assert len(response_json["content"]) == 2, response_json

Letta Config Using anthropic with claude 3.5 sonnet latest

Let me know if you need further details, Thank you!