search

getumbrel / llama-gpt

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
https://apps.umbrel.com/app/llama-gpt
MIT License
10.73k stars 696 forks source link

Please add Intel A770 support #116

Open johnuopini opened 11 months ago

johnuopini commented 11 months ago

Seems like its possible: https://github.com/openvinotoolkit/openvino_notebooks/pull/1207

They got LLAMA2 with A770 working A770 is super common on NUC and laptops

renegadespork commented 5 months ago

I would like to add +1 to this request. I have an Intel ARC A770 in my home server, and I would like to use it with this tool.