togethercomputer / OpenChatKit

Apache License 2.0
9.01k stars 1.01k forks source link

Environment Issues On Mac #137

Closed arokhsaz3 closed 1 year ago

arokhsaz3 commented 1 year ago

Hello, I run $ mamba env create -f environment.yml $, and I receive a package compatibility error that I have shown in the screenshot below. What can I do to fix this issue? Up until then everything seems to run correctly. Thanks!

I am trying to install under these conditions:

Screenshot 2023-06-11 at 2 53 52 PM
orangetin commented 1 year ago

Macs are not supported by OCK. A lot of the packages that you're seeing fail require a CUDA GPU (which Macs don't have).

There's a workaround, but do note that inference will be slow (because CPU/MPS), and training is not supported: see this comment

I'd recommend redpajama.cpp for inference or running OCK on a GPU device.

Dupe of #45