search

byronBBL / DeCK

Official repository of paper “Decoding by Contrasting Knowledge: Enhancing LLMs’ Confidence on Edited Facts”
https://deck-llm.meirtz.com/
7 stars 0 forks source link

Differences between deck and deck_pro #1

Open XZhang00 opened 2 months ago

XZhang00 commented 2 months ago

Hi, thanks for your solid work!

Could you introduce the difference between the mode "deck" and "deck_pro"?

Looking forward to your reply!

XZhang00 commented 2 months ago

Another question:

When I run the code "run_mello.py", it seems that the "stopping_criteria" does not work, leading to the generated_text containing some undesired content. How else can I solve this problem besides post-processing in Lines 66-69?

image
byronBBL commented 2 months ago

Hi, XZhang00,

Thank you very much for your interest in our work.

"deck" in our code means our method without "enh" moudule (you can find it in our paper) and "deck_pro" is complete version our our method. I suggest you can try the "deck" first.

Good luck.

byronBBL commented 2 months ago

For your another issue,

You can try for modifying the stopping_criteria in src/transformers/generation to match the transformers version and LLMs you are using, it may be work.

Good luck