search

AdelWang / MIGRES

12 stars 1 forks source link

File generated strange #2

Open yicong111 opened 4 months ago

yicong111 commented 4 months ago

Hi, I did data preparation(wiki-18) and ran the MIGRES. Then I get a json file in which only has one 'final_res' while the others "fail" is true. And I also get a empty json file called 'xxx_fail'. I'm not sure if the right code is running. Could you give more details?

AdelWang commented 4 months ago

Thanks for the feedback. The "fail.json" is to record the output of GPT when the code fails to parse the generation content, this could happen for two reasons: 1) GPT calls failed and returned an empty string and 2) the output was not in a correct json format.

However, when the GPT returned an empty string, the code would not record it in the fail.json file (see function "def askGPT"). I suspect the issue might be due to unsuccessful GPT calls. You could consider logging the GPT calls' responses and check if that is the case.