Support Baichuan-7B and Baichuan2-7B & 13B

modelscope / dash-infer

DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including x86 and ARMv9.

Apache License 2.0

137 stars 15 forks source link

Support Baichuan-7B and Baichuan2-7B & 13B #38

Closed WangNorthSea closed 3 months ago

WangNorthSea commented 3 months ago

Support Baichuan-7B and Baichuan2-7B & 13B