search

traceloop / openllmetry

Open-source observability for your LLM application, based on OpenTelemetry
https://www.traceloop.com/openllmetry
Apache License 2.0
1.52k stars 113 forks source link

🐛 Bug Report: disabled tests for GCP / VertexAI #417

Open nirga opened 4 months ago

nirga commented 4 months ago

Which component is this bug for?

VertexAI Instrumentation

📜 Description

Following #413, I had to disable the VertexAI tests since vcr.py doesn't support GRPC. We need to figure out how to mock those requests to avoid making actual calls to GRPC.

👟 Reproduction steps

N/A

👍 Expected behavior

N/A

👎 Actual Behavior with Screenshots

N/A

🤖 Python Version

No response

📃 Provide any additional context for the Bug.

No response

👀 Have you spent some time to check if this bug has been raised before?

Are you willing to submit PR?

None

MarkWinter21 commented 1 month ago

Hi, does this bug still need to be looked at? Alternatively, could you suggest another 'good first issue'. Thanks

nirga commented 1 month ago

Yes @MarkWinter21! We can look into either finding something like vcr.py that supports GRPC (which is what VertexAi is using), or just create a stub that mocks the calls to VertexAI ourselves. There's something more interesting for you to look at though, if you want - #1026