[Feature]: Vertex AI - support `tool_choice` for real

BerriAI / litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

https://docs.litellm.ai/docs/

Other

12.65k stars 1.47k forks source link

[Feature]: Vertex AI - support `tool_choice` for real #3235

Closed Manouchehri closed 1 month ago

Manouchehri commented 5 months ago

The Feature

https://cloud.google.com/vertex-ai/generative-ai/docs/model-reference/function-calling#functioncallingconfig-[preview]

Motivation, pitch

To be able to control what tool gets used.

Twitter / LinkedIn details

https://www.linkedin.com/in/davidmanouchehri/

Manouchehri commented 5 months ago

Eh, probably gonna wait to add this until for the httpx refactor like #2973.

krrishdholakia commented 1 month ago

closing as this is now supported