update kv cache for generation and fix chatglm2 - Githubissues

OpenMOSS / CoLLiE

Collaborative Training of Large Language Models in an Efficient Way

https://openlmlab-collie.readthedocs.io

Apache License 2.0

405 stars 58 forks source link

update kv cache for generation and fix chatglm2 #147

Closed KaiLv69 closed 8 months ago