search

THUDM / CogVLM

a state-of-the-art-level open visual language model | 多模态预训练模型
Apache License 2.0
5.91k stars 406 forks source link

Confidence score #496

Open joel-simp opened 3 months ago

joel-simp commented 3 months ago

Hi, How to check the confidence score or probability score of the generated text? Throwing me error when I try to find the logits

Screenshot 2024-06-19 at 12 20 19 PM
Dineshkumar-Anandan-ZS0367 commented 2 months ago

Apply normal ligits using torch and you need to pass output_scores=True to the model.gen function