search

liltom-eth / llama2-webui

Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use `llama2-wrapper` as your local llama2 backend for Generative Agents/Apps.
MIT License
1.97k stars 202 forks source link

multi gpu, llama2-70b #78

Open fo40225 opened 1 year ago

fo40225 commented 1 year ago

multi gpu support, llama2-70b fix, download revision