Does ktransformers support deepseek V2.5？

kvcache-ai / ktransformers

A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations

Apache License 2.0

741 stars 39 forks source link

Closed huliangbing closed 1 month ago

Azure-Tang commented 1 month ago

Yes～you can run v2.5 with deepseekv2‘s yaml.

huliangbing commented 1 month ago

Thank you very much!