replicate / cog-vicuna-13b

A template to run Vicuna-13B in Cog
https://replicate.com/replicate/llama-7b
Apache License 2.0
73 stars 19 forks source link

Release vicuna-13b on replicate #1

Closed joehoover closed 1 year ago

joehoover commented 1 year ago
### Tasks
- [ ] https://github.com/replicate/cog-vicuna-13b/issues/2
- [x] tensorize llama weights
- [x] test predictor locally
- [x] push to replicate
- [x] update readme
- [x] get tweets approved
joehoover commented 1 year ago

I've run into issues converting llama to vicuna. Spent some time debugging, but have not fixed yet.