search

SJTU-IPADS / PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
MIT License
7.97k stars 415 forks source link

Will this work with Falcon 2? #186

Open aaronrmm opened 6 months ago

aaronrmm commented 6 months ago

Will this work with Falcon 2?

Falcon 2 was released here: https://huggingface.co/tiiuae/falcon-11B