lm-sys / FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Apache License 2.0
35.53k stars 4.36k forks source link

Update model_adapter.py #3401

Open KnightLancelot opened 2 weeks ago

KnightLancelot commented 2 weeks ago
    # Due to the removal of the "fp16" attribute from Qwen2's config, the following conditional statement needs to be added if a Qwen2 model is to be used:
    if( "qwen2" not in str(config.__class__) ): 
        self.float_set(config, "fp16")

Why are these changes needed?

Related issue number (if applicable)

Checks