PyTorchEngine adapts to the latest internlm2 modeling.

InternLM / lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

https://lmdeploy.readthedocs.io/en/latest/

Apache License 2.0

3.13k stars 280 forks source link

Closed grimoire closed 1 week ago

lvhan028 commented 1 week ago

May merge the latest main since https://github.com/InternLM/lmdeploy/pull/1806 has resolved pr_ete_test CI workflow error

grimoire commented 1 week ago

Shall we make some log hints for users who used old internlm2?

There is no commit-id or other arguments in the config that indicate the version of code.