huggingface / speech-to-speech

Speech To Speech: an effort for an open-sourced and modular GPT4-o
Apache License 2.0
2.99k stars 314 forks source link

Function / tool calling support: make it more real-world & usable #35

Open ChristianWeyer opened 3 weeks ago

ChristianWeyer commented 3 weeks ago

To do really interesting things, we need to call functions / tools. It would be great to be easily able to wire up things outside the LLM.

Aka Jarvis 🥳.

andimarafioti commented 3 weeks ago

This is definitely what excites me most about this project. I will probably work on this after we get all the basics right, but if anyone wants to start I would love to welcome the contribution!