search

SJTU-IPADS / PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
MIT License
7.9k stars 406 forks source link

Will this work with Falcon 2? #186

Open aaronrmm opened 4 months ago

aaronrmm commented 4 months ago

Will this work with Falcon 2?

Falcon 2 was released here: https://huggingface.co/tiiuae/falcon-11B