As we embark on the initial phase of PowerInfer's development, our primary goal is to introduce the hybrid inference feature across all major desktop hardware and software platforms. Our current progress includes:
[x] x86 + NVIDIA on Linux: Available from day one.
[ ] M Chip on macOS: Preparations underway for Metal backend integration. Tracking at #88.
[x] x86 + NVIDIA on the latest version of Windows: Development underway. Tracking at #86.
[ ] x86 + NVIDIA under WSL: Supported yet troubleshooting ongoing. Tracking at #87.
This milestone marks a significant step in our journey 🚀. We are diligently working to achieve this goal within the coming weeks. Stay connected for more updates and feel free to join us in this exciting endeavor by contributing code! 🤝💻
As we embark on the initial phase of PowerInfer's development, our primary goal is to introduce the hybrid inference feature across all major desktop hardware and software platforms. Our current progress includes:
This milestone marks a significant step in our journey 🚀. We are diligently working to achieve this goal within the coming weeks. Stay connected for more updates and feel free to join us in this exciting endeavor by contributing code! 🤝💻