abi / secret-llama

Fully private LLM chatbot that runs entirely with a browser with no server needed. Supports Mistral and LLama 3.
https://secretllama.com
Apache License 2.0
2.28k stars 122 forks source link

Firefox support? #26

Open K0-RR opened 1 month ago

K0-RR commented 1 month ago

Currently we can see "Supported browsers: Chrome, Edge (GPU required)". Is Firefox support planned?

abi commented 1 month ago

Not at the moment since WebGPU is not available by default.

WebGPU support can be enabled in Firefox by going about:config I think. People have reported that it works well once enabled.