Closed nicholaschenai closed 10 months ago
in webarena/evaluation_harness/evaluators.py line 127, in class StringEvaluator, reference_answers expects a dict but task 301 and 302 gives a string. fixed it to be in line with other string match annotations
alr fixed in latest merge
in webarena/evaluation_harness/evaluators.py line 127, in class StringEvaluator, reference_answers expects a dict but task 301 and 302 gives a string. fixed it to be in line with other string match annotations