Show metric in outfile

[Muennighoff]

{
  "codexglue_code_to_text-python-left": 0.06565988797511521,
  "config": {
    "model": "bigcode/christmas-models"
  }
}

would be better to also have the metric imo

[loubnabnl]

That makes sense, how do you suggest including it? Add an arg to the task class or output the name of the metric after calling it in postprocess_results for example?

[Muennighoff]

Yeah I would return the metric name that we provide to evaluate.load, maybe sth like:

code_metric = load("code_eval")
results, _ = code_metric.compute(
    references=references,
    predictions=generations,
)
return {
    "code_eval": results,
}