Closed josh-chamberlain closed 4 months ago
Probably easiest to merge the current labeled data to one that associates each record_type to a record_type_category and use the record_type_category as the label instead.
@josh-chamberlain Does this association exist somewhere already or would we need to create it?
@mbodeantor it doesn't exist anywhere but that doc, nowhere in the data.
I've made a map for labels -> label_category, the updated csv of [url, label, label_category,...] will be up on hugging face or anywhere else you'd like it
@bonjarlow do you want to link your Hugging Face work to this / do you think there's anything else to do before calling this close? we can always continue to refine the model, but I think you did it
Agreed, conclusion is that record type category (coarse label) performs better than fine labels
How much better does the model perform if, instead of asking it for
record_type
, we ask it forrecord_type_category
? We can use the existing data for this. It also makes annotation much easier.The more granular record types are useful for people, but we may be able to get by without them.
https://docs.pdap.io/activities/data-dictionaries/record-types-taxonomy