search

pezzolabs / pezzo

🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.
https://pezzo.ai
Apache License 2.0
2.54k stars 210 forks source link

"Monitoring & Observability" not working in cloud version #323

Open amitmittal opened 1 month ago

amitmittal commented 1 month ago

Report

When using Pezzo.ai proxy and setting custom headers as given in (https://docs.pezzo.ai/introduction/tutorial-observability/overview), the requests are not getting logged and no data is shown in the "Request" tab on cloud version.

Using .Net Core package for OpenAI: https://github.com/openai/openai-dotnet

Expected behavior

When using Pezzo Proxy and setting pezzo api key, project id and environment, all the requests should be logged and report should be available from "Requests" page on pezzo.ai cloud portal.

Steps to reproduce the problem

  1. Using library: https://github.com/openai/openai-dotnet
  2. Set Endpoint: https://proxy.pezzo.ai/openai/v1
  3. Set Custom Headers: X-Pezzo-Api-Key, X-Pezzo-Project-Id and X-Pezzo-Environment with appropriate values.
  4. Send a chat completion request to openai using pezzo proxy.

Logs (if applicable)

example

Pezzo version

Cloud

How do you use Pezzo?

Pezzo Cloud