search

fixie-ai / ultravox

A fast multimodal LLM for real-time voice
https://ultravox.ai
MIT License
871 stars 47 forks source link

Land inference example in vLLM server #37

Closed juberti closed 1 month ago

juberti commented 1 month ago

Landing at long last with https://github.com/vllm-project/vllm/pull/7615