search

IBM / unitxt

🦄 Unitxt: a python library for getting data fired up and set for training and evaluation
https://www.unitxt.ai
Apache License 2.0
153 stars 39 forks source link

Make model based metrics rely on InferenceEngine #985

Open elronbandel opened 3 months ago

elronbandel commented 3 months ago

InferenceEngine abstraction can make model based metrics model invariant and updated with ease

A great example is the CodeMix by @arielge : https://github.com/IBM/unitxt/blob/9a9d5de744937243b8d6d307d97cb686819478b4/src/unitxt/metrics.py#L4002