lmstudio-ai / lmstudio-bug-tracker

Bug tracking for the LM Studio desktop application
2 stars 2 forks source link

Please add support for intel Mac. #9

Open savkinavmono opened 1 month ago

savkinavmono commented 1 month ago

Very cool application. It would be cool if there was a version for intel Mac. I know llama.cpp has problems with Metal on intel Mac. But what about CPU or Vulkan version?

Abbasi-Alain commented 1 month ago

I utilize a powerful Intel 2.3 GHz 8-Core Intel Core i9 Mac equipped with an AMD Radeon Pro 5500M 8 GB GPU and 64 GB of RAM for my machine learning tasks, alongside local Linux servers and cloud resources. It's puzzling that your application lacks support for Intel CPUs with AMD ROCm, especially considering the prevalent usage of Intel CPUs in data centers where optimization for Intel architecture has been a standard practice for over two decades !

Given that many machine learning and large language model libraries are optimized for Intel CPUs, it's imperative to include support for Intel Macs. By incorporating this support, your application can cater to a broader user base and seamlessly integrate with existing Intel-based infrastructure, enhancing accessibility and performance for a significant portion of your audience.

Any MLOps Architect inherently uses Intel based CPUs or Intel Based Mac for workflow and optimisation.

Thanks in advance for your consideration, meanwhile I'll continue to use my workflow using self build solutions.