add GGUF model router support across all model types & refactor the code

NexaAI / nexa-sdk

Nexa SDK is a comprehensive toolkit for supporting GGML and ONNX models. It supports text generation, image generation, vision-language models (VLM), Audio Language Model, auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.

https://docs.nexa.ai/

Apache License 2.0

4.43k stars 654 forks source link

add GGUF model router support across all model types & refactor the code #223

Closed qmeng222 closed 2 weeks ago