Add CPU support to one_file_ref.py (the one file implementation) - Githubissues

mistralai / mistral-inference

Official inference library for Mistral models

https://mistral.ai/

Apache License 2.0

9.37k stars 817 forks source link

Add CPU support to one_file_ref.py (the one file implementation) #129

Open kikirizki opened 5 months ago

kikirizki commented 5 months ago

please use CPU whenever GPU unavailable