search

livekit / agents

Build real-time multimodal AI applications 🤖🎙️📹
https://docs.livekit.io/agents
Apache License 2.0
4.07k stars 427 forks source link

feat: add support for vertex ai #1042

Closed jayeshp19 closed 3 days ago

changeset-bot[bot] commented 3 weeks ago

🦋 Changeset detected

Latest commit: 877b7d514a840c731666cea6b7973291924e4d73

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 1 package | Name | Type | | ---------------------- | ----- | | livekit-plugins-google | Minor |

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

theomonnom commented 2 weeks ago

Do you think there is a way we reuse https://github.com/livekit/agents/blob/main/livekit-agents/livekit/agents/llm/_oai_api.py when running/checking function calls. The good think about it is that it verify the types are correct before running any code

jayeshp19 commented 2 weeks ago

@theomonnom I think we could reuse create_ai_function_info from _oai_api.py, but build_oai_function_description wouldn't be compatible, since Vertex AI doesn’t accept the same function description format as OpenAI.

jayeshp19 commented 2 weeks ago

@theomonnom I've updated code to utilize create_ai_function_info from_oai_api.py

jayeshp19 commented 3 days ago

Closing this as this feature is already implemented https://github.com/livekit/agents/pull/1084