Could you make one for Apple Silicon mac?

Akegarasu / ChatGLM-webui

A WebUI for ChatGLM-6B

1.92k stars 256 forks source link

Could you make one for Apple Silicon mac? #4

Closed Autumn-Whisper closed 1 year ago

Autumn-Whisper commented 1 year ago

Thank you for providing the web UI! However, I am currently using a laptop with an RTX3060, which means that I am only able to use the CPU. Unfortunately, the CPU is too slow and the performance is not ideal. On the other hand, I also have a MacBook Air with an M2 processor and 16GB of RAM. Would it be possible for you to create a version of the UI that is compatible with Apple Silicon macs? I would greatly appreciate it if I could use the UI on my MacBook.

zhouyihaocc commented 1 year ago

you can use the cpu mode on mac, just add --cpu to the command when you start the webui. I'm also use mac to run this model and it works for me.

Akegarasu commented 1 year ago

--cpu