Can I request your code on how to calculate the generation accuracy? Do you conduct substring match to find if ground truth answer occurs in the generated answer or do you adopt other evaluation methods, e.g., NLI/classifier/LLM evaluator to calculate the accuracy?
Hi Guangzhi,
Thank you for your great work!
Can I request your code on how to calculate the generation accuracy? Do you conduct substring match to find if ground truth answer occurs in the generated answer or do you adopt other evaluation methods, e.g., NLI/classifier/LLM evaluator to calculate the accuracy?
Best, Bowen