How to run the gradio with 30B model? and what devices are needed? please - Githubissues

juncongmoo / pyllama

LLaMA: Open and Efficient Foundation Language Models

GNU General Public License v3.0

2.8k stars 312 forks source link

How to run the gradio with 30B model? and what devices are needed? please #64

Open TobiasWYH opened 1 year ago