Batch data processing in hallucination pipeline and balance the data

awslabs / fortuna

A Library for Uncertainty Quantification.

https://aws-fortuna.readthedocs.io/en/latest/

Apache License 2.0

891 stars 46 forks source link

Closed gianlucadetommaso closed 1 year ago

gianlucadetommaso commented 1 year ago

This PR makes the following changes to the hallucination pipeline:

remove possibility of multi-answers. It makes the code less simple and it is not useful.
Batch the data processing.
Add option to balance the calibration data (default: True).