search

smpanaro / coreml-llm-cli

CLI to demonstrate running a large language model (LLM) on Apple Neural Engine.
43 stars 3 forks source link

M2 Pro Performance #2

Open kunwarsahni01 opened 1 month ago

kunwarsahni01 commented 1 month ago
Screenshot 2024-07-11 at 11 05 54 AM

M2 Pro (12 (8 performance and 4 efficiency) Cores, 32GB RAM, 19 GPU Cores) Performance on macOS Sonoma (14.5). Will try Sequoia next.

smpanaro commented 1 month ago

Added this to the readme! Let me know if you have a chance to try on Sequoia, would be happy to add it as well.