alexrozanski / llama.swift

Fork of llama.cpp, supporting Facebook's LLaMA model in Swift
MIT License
154 stars 10 forks source link

Metal support from upstream llama.cpp #7

Open zshannon opened 1 year ago

zshannon commented 1 year ago

Hey there, in case you missed it wanted to point out Metal support merged into llama.cpp in the last few days. It's really fast! What would it take to pull in those changes from upstream here?

alexrozanski commented 1 year ago

@zshannon merging in changes from master-aacdbd4 in llama.cpp — see #8 for progress