How to run vicuna on a CPU with 16GB of RAM?

Facico / Chinese-Vicuna

Chinese-Vicuna: A Chinese Instruction-following LLaMA-based Model —— 一个中文低资源的llama+lora方案，结构参考alpaca

https://github.com/Facico/Chinese-Vicuna

Apache License 2.0

4.14k stars 421 forks source link

Closed DimIsaev closed 1 year ago

DimIsaev commented 1 year ago

Found an instruction only in C++ How to implement this in Python? Thanks