kupl / apps-sal

Programming Competition Style Python Codes Datasets
MIT License
1 stars 0 forks source link

Division by Zero in `pass@k` When `k` is Larger Than `n` #75

Closed henrylee97 closed 2 years ago

henrylee97 commented 2 years ago

Symptom

Division by zero exception in pass@k when k is larger than the length of the submissions n.

How To Reproduce

from apps_sal.metric import pass_at_k
pass_at_k({'0':[1, 0, 1], '1': [1, 0]}, 3)