search

tianlimin2 / LLM-server_Limin-TIAN_CDOF5

This server is currently running on Linux and Windows. We are working to develop it further so that it can also run on Mac.
MIT License
0 stars 1 forks source link

Need guidance on setting up LLM on Mac #2

Open tianlimin2 opened 7 months ago

tianlimin2 commented 7 months ago

Users are seeking assistance or guidance on how to properly set up and configure the LLM function to run on Mac systems. They may be facing difficulties in installing dependencies, configuring environment variables, or resolving any other setup-related issues specific to macOS.

azddzasw commented 7 months ago

Mac can not use CDDA but you can use mps for LLM training, you can use code like: to.('ops')

azddzasw commented 7 months ago

to.('mps')

tianlimin2 commented 7 months ago

thanks !