search

kupl / apps-sal

Programming Competition Style Python Codes Datasets
MIT License
1 stars 0 forks source link

Divide By Zero When Category Is Empty While Printing Report #57

Closed henrylee97 closed 2 years ago

henrylee97 commented 2 years ago

Symptom

Divide by zero in metric report when some categories are empty.

How To Reproduce

Try following command:

$ apps-sal -m eval -s test -t code.json -to 3 --metric strict testcase pass@k --pass-at-k 1 5 --end 10