replicate / cog-llama-template

LLaMA Cog template
Apache License 2.0
306 stars 52 forks source link

[XS] Add FP16 Non-Chat Models #69

Closed moinnadeem closed 11 months ago

moinnadeem commented 11 months ago

Our non-chat models exhibit an odd error where they start speaking in Russian. For our non-chat models, we can upload a copy in FP16 to avoid that.