Closed huyiwen closed 1 month ago
The original aggregate method of pass@k and self-consistency does not apply to dataset with multiple subsets. So now we apply aggregate for each subset separately.
The original aggregate method of pass@k and self-consistency does not apply to dataset with multiple subsets. So now we apply aggregate for each subset separately.