Phi 2 model - Githubissues

rahuldshetty / llm.js

Run Large-Language Models (LLMs) 🚀 directly in your browser!

https://rahuldshetty.github.io/llm.js/

Apache License 2.0

167 stars 11 forks source link

Open mtasic85 opened 9 months ago

mtasic85 commented 9 months ago

Is there a way to load Phi 2 model?

rahuldshetty commented 8 months ago

Unfortunately its not possible to run the original phi-2 model on the browser with llm.js mainly due to the memory limitation on the WASM engine.