search

zhaoxlpku / HKU-DASC7606-A2

18 stars 11 forks source link

Task6 #10

Open hkcoserlamyiupong opened 6 months ago

hkcoserlamyiupong commented 6 months ago

Task 6: Implement Code to Calculate the Log-Likelihood of an Answer Choice

Complete relevant sections within eval_fewshot.py and eval_fewshot_multigpu.py to calculate the likelihood of each answer choice. From the description, may I ask should we calculate likelihood or log-likelihood?

zhaoxlpku commented 6 months ago

My apologies for the delayed response. Please calculate the log-likelihood.