Enhancement: Add Metrics/Tracking operations - Githubissues

rmusser01 / tldw

Too Long, Didn't Watch(TL/DW): Your Personal Research Multi-Tool - Open Source NotebookLM (eventually)

Apache License 2.0

162 stars 6 forks source link

Enhancement: Add Metrics/Tracking operations #235

Open rmusser01 opened 2 weeks ago

rmusser01 commented 2 weeks ago

Title. https://github.com/traceloop/openllmetry

Add Metrics For:

[ ] video ingestion pipeline
[ ] Audio ingestion pipeline
[ ] Podcast ingestion pipeline
[ ] Ebook ingestion pipeline
[ ] plain text ingestion pipeline
[ ] website scraping
[ ] PDF ingestion pipeline
[ ] Live Recording & transcription pipeline
[ ] Embeddings Management - Creation time,

Non-Media Ingestion

[ ] Text search pipelines
[ ] RAG Search
[ ] RAG QA search
[ ] Every chat pipeline
[ ] Searching/Viewing Media DB
[ ] Viewing Prompt DB
[ ] Searching prompts DB
[ ] Metrics

rmusser01 commented 2 weeks ago

https://hamel.dev/blog/posts/evals/