search

voidism / DoLa

Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"
https://arxiv.org/abs/2309.03883
419 stars 50 forks source link

Typo? mode = "early_exit_contrastive" -> mode = "dola-static" #16

Closed young-j-park closed 5 months ago

young-j-park commented 6 months ago

https://github.com/voidism/DoLa/blob/02e514468767e2d36bc5207a2b92992f3224c749/tfqa_mc_eval.py#L279

But there's no corresponding mode within lm_score funciton.

https://github.com/voidism/DoLa/blob/02e514468767e2d36bc5207a2b92992f3224c749/dola.py#L138

voidism commented 6 months ago

You are right! Let me fix this. Thanks!