fix: do not resolve vertex project id from creds

[ushuz]

Title

fix: do not resolve vertex project id from creds

Type

🐛 Bug Fix

Changes

vertex_ai_project set in config should always prevail for vertex_ai_beta provider, just like how it's done in vertex_ai provider.

Reasons:

• Certain Google credentials do not provide a project id
• The project ID resolved from the credential may not match the model serving project, e.g. service account is from project A, but models are served from project B

Steps:

• Set up local Google ADC with personal Google account.
• Mount Google ADC into container
• Send requests to a vertex_ai_beta provider.

Before: It fails to resolve a project ID, because personal ADC doesn't have one.

After: It works, just like vertex_ai provider.

[vercel[bot]]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jun 27, 2024 10:35pm