Qingying model router streamlit refactor

NexaAI / nexa-sdk

Nexa SDK is a comprehensive toolkit for supporting GGML and ONNX models. It supports text generation, image generation, vision-language models (VLM), Audio Language Model, auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.

https://docs.nexa.ai/

Apache License 2.0

4.43k stars 654 forks source link

Qingying model router streamlit refactor #222

Closed qmeng222 closed 3 weeks ago

qmeng222 commented 3 weeks ago

Add GGUF model router support across all model types (NLP, Vision, Multimodal, and Audio) in Streamlit. Refactored.