Also pass `metric_kwargs` to custom metric callable

huggingface / setfit

Efficient few-shot learning with Sentence Transformers

https://hf.co/docs/setfit

Apache License 2.0

2.25k stars 223 forks source link

Also pass `metric_kwargs` to custom metric callable #456

Closed tomaarsen closed 11 months ago

tomaarsen commented 11 months ago

Hello!

Pull Request overview

Also pass metric_kwargs to custom metric callable

Details

You can define metric_kwargs in the Trainer to pass kwargs to an evaluate metric, but now you can also use those kwargs to pass them to your own custom metric callable. See #454 for the feature request.

Will be merged into v1.0.0-pre, which will be merged into main this week & released.

cc: @psorianom Thanks for the feature request :)

Tom Aarsen

HuggingFaceDocBuilderDev commented 11 months ago

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.