This description was created by Ellipsis for commit fa5b52d3015d6c89924dd73f5ac9f5a6cf95eea3
feat: Add dialog entries summarization and update truncation logic
Summary:
Enhance dialog entries summarization and update truncation logic for improved chat session management.
Key points:
Summarization: Implement summarization() using summarize_messages, get_entities, and trim_messages in summarization.py. Add entries_summarization_query and get_toplevel_entries_query in entries_summarization.py.
Truncation: Implement truncation() in truncation.py to delete entries based on token count. Add get_extra_entries function in truncation.py.
Workflow: Modify TruncationWorkflow in truncation.py to include developer_id. Add run_truncation_task and run_summarization_task in temporal.py.
Chat Handling: Update chat.py to handle context overflow and raise PromptTooBigError.
Miscellaneous: Change response type in create_or_update_session.py to ResourceUpdatedResponse. Add debug print in litellm.py.
feat: Add dialog entries summarization and update truncation logic
Summary:
Enhance dialog entries summarization and update truncation logic for improved chat session management.
Key points:
summarization()usingsummarize_messages,get_entities, andtrim_messagesinsummarization.py. Addentries_summarization_queryandget_toplevel_entries_queryinentries_summarization.py.truncation()intruncation.pyto delete entries based on token count. Addget_extra_entriesfunction intruncation.py.TruncationWorkflowintruncation.pyto includedeveloper_id. Addrun_truncation_taskandrun_summarization_taskintemporal.py.chat.pyto handle context overflow and raisePromptTooBigError.create_or_update_session.pytoResourceUpdatedResponse. Add debug print inlitellm.py.Generated with :heart: by ellipsis.dev