Closed tpoisonooo closed 2 months ago
If kimi model name use auto, llm_server_hybrid.py would auto select model by prompt lenght.
kimi
auto
llm_server_hybrid.py
If
kimi
model name useauto
,llm_server_hybrid.py
would auto select model by prompt lenght.