HKUST-KnowComp / Knowledge-Constrained-Decoding

Official Code for EMNLP2023 Main Conference paper: "KCTS: Knowledge-Constrained Tree Search Decoding with Token-Level Hallucination Detection"
27 stars 0 forks source link

Questions on guide GPT-3.5 #3

Open cheesemarmot opened 4 months ago

cheesemarmot commented 4 months ago

Hello, I really admire the dedication and effort you put into your work. But I have few questions on the process when i was using the scripts to train GPT2XL and guide the decoding of GPT3.5.

First, what I want to know is how the checkpoint-best/pytorch_model.bin comes. Do you mean it comes from your training process or just from the original model? When I loaded the script of fine-tune RIPA on gpt2, it did not work at all and showed the weight missing.

Second, would you be so kind to provide the version of packages in requirements.txt ? That will help a lot.

I appreciate your time and assistance in clarifying these points.