issues
search
empirical-run
/
empirical
Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application
https://docs.empirical.run
MIT License
146
stars
11
forks
source link
Integrate Empirical with Google Vertex AI
#238
Open
archie-ai-code-explain-pr-review[bot]
opened
1 month ago
archie-ai-code-explain-pr-review[bot]
commented
1 month ago
Empirical currently supports Gemini models via Google API keys, which are accessed through Google AI Studio and Google Workspaces
The user's company uses Vertex AI within Google Cloud, which is accessed through IAM policies/application default credentials, rather than API keys
Integrating Vertex AI with Empirical could provide access to a wider range of models, including those from Google, Anthropic, Mistral, and others
The user is unsure if this integration is possible, but believes it would be beneficial