The MPS backend is supported on MacOS 12.3+.Current OS version can be queried using `sw_vers`

josStorer / RWKV-Runner

A RWKV management and startup tool, full automation, only 8MB. And provides an interface compatible with the OpenAI API. RWKV is a large language model that is fully open source and available for commercial use.

https://www.rwkv.com

MIT License

5.25k stars 499 forks source link

The MPS backend is supported on MacOS 12.3+.Current OS version can be queried using `sw_vers` #388

Closed wudisong-hub closed 1 month ago

wudisong-hub commented 2 months ago

mac使用出现异常，请教下该如何解决？使用的模型是

josStorer commented 1 month ago

用WebGPU Python, 速度更快，占用更低

wudisong-hub commented 1 month ago

您是指换一个模型吗？但是我的模型里没有这一款？是另外一模型文件地址吗？能否提供下？

josStorer commented 1 month ago

Strategy一栏，把MPS改成WebGPU(Python)

wudisong-hub commented 1 month ago

感谢，我用我的window使用WebGPU(Python)可以了