search

InternLM / lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
https://lmdeploy.readthedocs.io/en/latest/
Apache License 2.0
4.31k stars 388 forks source link

fix best_match_model #1812

Closed irexyc closed 3 months ago

irexyc commented 3 months ago

Motivation

The tokenizer in transformers < 4.34.0 doesn't have chat_template attributes.

https://github.com/huggingface/transformers/blob/v4.34.0/src/transformers/tokenization_utils_base.py#L1640

lvhan028 commented 3 months ago

UT failed