raga-ai-hub / AgentNeo

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view
https://agentneo.raga.ai/
GNU General Public License v3.0
1.09k stars 76 forks source link

Add Memory Profiling Capabilities #123

Open ujjman opened 2 days ago

ujjman commented 2 days ago

Description

Added Memory Profiling Capabilities to monitor memory usage during AI operations (during LLM calls). You can see "peak memory used", "heap summary" and "garbage collection summary" on the dashboard inside each LLM card.

Type of Change

How Has This Been Tested?

There is test file with this PR in tests/test_memory_profiling.py run python -m unittest test_memory_profiling.py to verify the tests. Also, there is an example file in examples/memory_profiling_test.py.

Checklist:

Additional Context

image

image

image