Closed henrylee97 closed 2 years ago
Division by zero exception in pass@k when k is larger than the length of the submissions n.
pass@k
k
n
from apps_sal.metric import pass_at_k pass_at_k({'0':[1, 0, 1], '1': [1, 0]}, 3)
Symptom
Division by zero exception in
pass@k
whenk
is larger than the length of the submissionsn
.How To Reproduce