How to do inference on GPUs

tairov / llama2.mojo

Inference Llama 2 in one file of pure 🔥

MIT License

2.09k stars 139 forks source link

Closed toutouya closed 4 months ago

tairov commented 4 months ago

Hi @toutouya , unfortunately GPU inference is not yet supported by Mojo. We hope it get support soon