Open meteatamel opened 4 months ago
DeepEval docs have a Google Vertex AI implementation sample here: https://docs.confident-ai.com/docs/metrics-introduction#google-vertexai-example
However, it has a number of issues:
GoogleVertexAI
I implemented another version here that fixes these issues: https://github.com/meteatamel/genai-beyond-basics/tree/main/samples/evaluation/deepeval/vertex_ai
I have the two variants: one that uses Vertex AI directly, one that uses Vertex AI via LangChain.
I also have 3 samples how to use it here: https://github.com/meteatamel/genai-beyond-basics/tree/main/samples/evaluation/deepeval
I'm hoping the DeepEval documentation can be updated to use these implementations instead.
@meteatamel Thanks for the comments, will definitely update it :)
DeepEval docs have a Google Vertex AI implementation sample here: https://docs.confident-ai.com/docs/metrics-introduction#google-vertexai-example
However, it has a number of issues:
GoogleVertexAI
classI implemented another version here that fixes these issues: https://github.com/meteatamel/genai-beyond-basics/tree/main/samples/evaluation/deepeval/vertex_ai
I have the two variants: one that uses Vertex AI directly, one that uses Vertex AI via LangChain.
I also have 3 samples how to use it here: https://github.com/meteatamel/genai-beyond-basics/tree/main/samples/evaluation/deepeval
I'm hoping the DeepEval documentation can be updated to use these implementations instead.