search

mainframecomputer / fullmoon-ios

chat with private and local large language models
https://fullmoon.app
MIT License
422 stars 43 forks source link

CoreML Implementation? #3

Open kunwarsahni01 opened 1 month ago

kunwarsahni01 commented 1 month ago

Any thoughts on also enabling a CoreML implementation? Using Swift-Transformers and CoreML you can squeeze out some more performance and actually enable use of the Apple Neural Engine. Can help with implementation if there is interest.