alexrozanski / llama.swift

Fork of llama.cpp, supporting Facebook's LLaMA model in Swift
MIT License
157 stars 11 forks source link

Would you share the 3B model weights after quant. #9

Open moaljazaery opened 1 year ago

alexrozanski commented 1 year ago

@moaljazaery is this the replit model? changes are in the works for LlamaChat v2 which will make using other models a lot easier so stay tuned!

moaljazaery commented 1 year ago

Thanks for your reply.

Do you have the quantized version of the models that are supported by this library uploaded somewhere?