Enhancements to Memory Management and Logging, and Bug Fixes

blazickjp commented 10 months ago

Type

Enhancement, Bug fix

Description

This PR introduces significant enhancements and bug fixes. The main changes include:

Introduction of a new class WorkingContext to manage the working context of the application.
Addition of a new class ContextUpdate to add information from the working context.
Update of the MemoryManager class with new attributes and methods, including a WorkingContext instance and a method update_context to update the working context asynchronously.
Update of the message_streaming method in backend/main.py to include background_tasks for executing tasks in the background.
Addition of new endpoints get_context and logs/errors in backend/main.py to get the working context and error logs respectively.
Update of test cases for the MemoryManager class in backend/tests/test_memory_manager.py.
Introduction of a new class RelevantLogHandler in backend/agent/agent_prompts.py to handle relevant logs.
Update of the SystemPromptHandler class in backend/memory/system_prompt_handler.py to include a RelevantLogHandler instance and the working context.
Minor bug fix in frontend/components/DirectorySelectOption.js to handle the 'Tab' key press.

PR changes walkthrough

Relevant files

Enhancement

4 files

memory_manager.py backend/memory/memory_manager.py The file `backend/memory/memory_manager.py` has been significantly refactored. - A new class `WorkingContext` has been introduced to manage the working context of the application. It includes methods to create tables, add, get, and remove context. - A new class `ContextUpdate` has been introduced to add information from the working context. - The `MemoryManager` class has been updated with new attributes and methods. It now includes a `WorkingContext` instance and a method `update_context` to update the working context asynchronously. - The `add_message` method has been updated to include a check for function calls. - The `set_directory` method has been added to set the project directory.	+182/-5
main.py backend/main.py The file `backend/main.py` has been updated with several changes. - The `message_streaming` method now includes `background_tasks` to add tasks that are executed in the background. - The `set_directory` method has been updated to set the project directory in the `MemoryManager` instance. - New endpoints `get_context` and `logs/errors` have been added to get the working context and error logs respectively. - Several print statements have been removed for cleaner code.	+30/-18
agent_prompts.py backend/agent/agent_prompts.py The file `backend/agent/agent_prompts.py` has been updated with new prompts and a new class `RelevantLogHandler` to handle relevant logs.	+35/-7
system_prompt_handler.py backend/memory/system_prompt_handler.py The file `backend/memory/system_prompt_handler.py` has been updated with several changes. - A new class `RelevantLogHandler` has been introduced to handle relevant logs. - The `SystemPromptHandler` class has been updated to include a `RelevantLogHandler` instance and the working context. - The `set_system` method has been updated to include the working context and relevant logs in the system prompt.	+54/-4