JBoRu / StructGPT

The code and data for "StructGPT: A general framework for Large Language Model to Reason on Structured Data"
Apache License 2.0
97 stars 39 forks source link

what is "aliases" in "evaluate_for_webqsp.py" ? #17

Open GaoZhitao121 opened 6 months ago

GaoZhitao121 commented 6 months ago

Thanks for sharing the codes. But I have some questions about "aliases" in "evaluate_for_webqsp.py"

aliases = data['Aliases']
....
for alia in aliases:
      alia = alia.lower()
      if alia in pred:
          hit_flag.append(1)
      else:
          hit_flag.append(0)

It looks like this is a different alias for the answer, can you post the file or explain how to get it? Thank you very much!

JBoRu commented 6 months ago

Obtain it from this repo: https://github.com/tan92hl/Complex-Question-Answering-Evaluation-of-GPT-family ---- Replied Message ---- @.>Date04/22/2024 11:52 @.> @.>Subject[JBoRu/StructGPT] what is "aliases" in "evaluate_for_webqsp.py" ? (Issue #17) Thanks for sharing the codes. But I have some questions about "aliases" in "evaluate_for_webqsp.py" aliases = data['Aliases'] .... for alia in aliases: alia = alia.lower() if alia in pred: hit_flag.append(1) else: hit_flag.append(0) It looks like this is a different alias for the answer, can you post the file or explain how to get it? Thank you very much! — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you are subscribed to this thread.Message ID: @.>

GaoZhitao121 commented 6 months ago

@JBoRu thank you so much!