Compatible with Intel Arc dGPUs?

mistralai / mistral-inference

Official inference library for Mistral models

https://mistral.ai/

Apache License 2.0

9.58k stars 846 forks source link

Open prakal opened 1 year ago

prakal commented 1 year ago

Thanks for the release! How much of a lift is it to get it running on an Intel Arc A770 16 GB GPU?

ThePerfectComputer commented 10 months ago

You should be able to run one_file_ref.py on your GPU using pure PyTorch as PyTorch supports the ARC A770.