SJTU-IPADS / PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
MIT License
7.96k stars 412 forks source link

will it run on windows ? #115

Closed Sandy4321 closed 10 months ago

Sandy4321 commented 10 months ago

Prerequisites

Before submitting your question, please ensure the following:

Question Details

will it run on windows ?

Additional Context

i use windows 10 , no gpu, 150GB ram

hodlen commented 10 months ago

We are actively developing Windows support. Please keep an eye on issue #86 for updates. As of now, CPU inference support is available in PR #114.

Although this feature is still in the experimental phase, we welcome you to give it a try.

Sandy4321 commented 10 months ago

pls do it asap