Open bauersimon opened 7 months ago
Hi @bauersimon , the quick answer for your question is:
import evaluate
import numpy as np
- m = evaluate.load('mse')
+ m = evaluate.load('mse', 'multilist')
print(m.compute(predictions=np.random.rand(16,2), references=np.random.rand(16,2)))
And, the error message is also too vague to address the problem.
Thanks! Should probably be mentioned in the docs then 😅.
The evaluation card for MSE states:
Mandatory inputs:
predictions
: numeric array-like of shape (n_samples,) or (n_samples, n_outputs), representing the estimated target values.references
: numeric array-like of shape (n_samples,) or (n_samples, n_outputs), representing the ground truth (correct) target values.So it should be usable similar to
pytorch
'sMSELoss
with multiple dimensions. But using it with(batch_size, multiple_outputs)
doesn't work:⬇️
Version:
evaluate==0.4.1