replicate / cog-llama-template

LLaMA Cog template
Apache License 2.0
307 stars 52 forks source link

[XS] Add FP16 Non-Chat Models #69

Closed moinnadeem closed 1 year ago

moinnadeem commented 1 year ago

Our non-chat models exhibit an odd error where they start speaking in Russian. For our non-chat models, we can upload a copy in FP16 to avoid that.