search

janhq / docs

Jan.ai Website & Documentation
https://jan.ai/
15 stars 4 forks source link

Unable to turn on GPU mode on Apple Silicon #197

Closed aifan123 closed 2 weeks ago

aifan123 commented 3 weeks ago

I am running Jan AI on a Macbook Pro with Apple silicon: M1 Pro I was under the impression that I would be able to activate the GPU setting to accelerate the model responses. However, I don't see the option for GPU acceleration in Advanced Settings. Not sure why that's the case, since the documentation seems to suggest that it should be doable.

irfanpena commented 2 weeks ago

Hi, Apple silicon mac should have Metal as the GPU acceleration, and it automatically turned on so you don't need to manually turn it on. We also have updated the docs per this: https://jan.ai/docs/desktop/mac#metal-acceleration. Thank you

aifan123 commented 2 weeks ago

Great, thanks for the update!

On Tue, May 14, 2024 at 3:57 AM irfanpena @.***> wrote:

Hi, Apple silicon mac should have Metal as the GPU acceleration, and it automatically turned on so you don't need to manually turn it on. We also have updated the docs per this: https://jan.ai/docs/desktop/mac#metal-acceleration. Thank you

— Reply to this email directly, view it on GitHub https://github.com/janhq/docs/issues/197#issuecomment-2109523561, or unsubscribe https://github.com/notifications/unsubscribe-auth/BB4RDBHM3XXHT5XVSXHRF7TZCG7WXAVCNFSM6AAAAABHR3JXESVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBZGUZDGNJWGE . You are receiving this because you authored the thread.Message ID: @.***>