argilla-io / argilla

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
https://docs.argilla.io
Apache License 2.0
3.91k stars 368 forks source link

Weak supervision for token classification metrics #1959

Closed keithCuniah closed 1 year ago

keithCuniah commented 1 year ago

refs #1767

I have a suggestion to validate :

When there is no query, the component Rules Metric doesn't have the total number of coverage and total annotated coverage. So to keep an atomic design, is it possible to show at the initialization the Rules Metric like this :

image

It's different from the TextClassification, since the totals are already showned image

dvsrepo commented 1 year ago

I like your suggestion! and I would apply it also to the TextClassification view, let's see what the others think

Amelie-V commented 1 year ago

Agree!

frascuchon commented 1 year ago

This is related to the weak label changes for the Text classification task, right?

keithCuniah commented 1 year ago

This behavior was only in Token Classification but it will be put in text classification too

frascuchon commented 1 year ago

Refs #1749