search

opea-project / GenAIComps

GenAI components at micro-service level; GenAI service composer to create mega-service
Apache License 2.0
76 stars 140 forks source link

[Feature] RouteLLM #936

Open joshuayao opened 4 days ago

joshuayao commented 4 days ago

Priority

P1-Stopper

OS type

Ubuntu

Hardware type

Xeon-GNR

Running nodes

Single Node

Description

RouteLLM