latitude-dev / latitude-llm

Latitude is the open-source prompt engineering platform to build, evaluate, and refine your prompts with AI
https://latitude.so
GNU Lesser General Public License v3.0
859 stars 56 forks source link

Feature Request: Add Option to Download Logs in the UI and API #587

Open NewtTheWolf opened 2 days ago

NewtTheWolf commented 2 days ago

Summary

I would like to request a feature to enable downloading logs directly from the Latitude UI (/reports) with an associated API endpoint that retrieves the logs. This would streamline reporting and allow for detailed analytics operations.

Use Case

The ability to download logs serves multiple purposes:

  1. Reporting: Automate the generation of detailed reports based on log data.
  2. Analytics: Facilitate external data analysis on prompts, user interactions, and performance metrics over time.

Proposed Functionality

  1. UI Enhancement:
    • Add a "Download Logs" option within the logs or reports section of the UI.
    • Allow users to specify filters (e.g., date range, specific prompt name, or other custom rules) to limit the logs included in the download.
  2. API Endpoint:
    • Create a dedicated API endpoint that provides log data based on specified filters.
    • Include support for parameters such as:
      • Date range
      • Specific prompt(s) or document path
      • Rule-based filtering (e.g., logs containing specific keywords or meeting specific evaluation scores).

Potential Filters

Benefits

This feature would allow teams to easily extract logs for offline analysis, compliance reporting, and process improvements, making Latitude even more robust for business and analytics needs.

Thank you for considering this feature request!

geclos commented 2 days ago

should be very ez to implement a get endpoint in gateway