Closed tylerbrandt closed 7 months ago
Hi @tylerbrandt - will update this ticket when the PR is merged - https://github.com/BerriAI/litellm/pull/2433
DM'ed on LinkedIn to create a direct support channel. Let me know if another channel (e.g. Discord/Slack) works better.
What happened?
I configured the proxy server with the following
built a virtualenv and ran it:
and attempted to call it with the snippet:
I got an error response back:
Full debug log is included below. I was able to resolve the issue by adding a dependency on
google-cloud-aiplatform
torequirements.txt
(as noted on the Vertex AI page) and rebuilding.Requiring the additional package is fine for usage as a library, but when using the proxy server using e.g. docker-compose or kubernetes I haven't come up with a simple way to add the dependency without rebuilding the image. Should the
google-cloud-aiplatform
dependency be installed by default? Is there a reason it isn't (it seems like many third-party dependencies for supporting generation using various models are installed, includinggoogle-generativeai
)?Relevant log output
Twitter / LinkedIn details
No response