ray-project / llm-applications

A comprehensive guide to building RAG-based LLM applications for production.
Creative Commons Attribution 4.0 International
1.71k stars 229 forks source link

Add structured logging for query outputs and update service #54

Closed pcmoritz closed 1 year ago

pcmoritz commented 1 year ago

This PR adds logging for the query outputs, so we know which documents were fed into the context, which model was used and which answer was returned to the user. Structured logging allows us to parse the logs later and extract the information we are interested in.