search

IBM / unitxt

🦄 Unitxt: a python library for getting data fired up and set for training and evaluation
https://unitxt.rtfd.io
Apache License 2.0
139 stars 29 forks source link

Turn safety and regard metrics to pure unitxt #946

Open elronbandel opened 1 week ago

elronbandel commented 1 week ago

Those metrics cannot be loaded trough huggingface load dataset until re implementated as unitxt metrics.

dafnapension commented 1 week ago

Hi @elronbandel , I gladly accept, but need some education..

dafnapension commented 4 days ago

Running prepare/cards/bold.py which uses: metrics=["metrics.regard"], am I expected to go through metrics.regard._compute(..) ? It seems that I do not. I am missing the point here, I suspect.