IndicoDataSolutions / finetune

Scikit-learn style model finetuning for NLP
https://finetune.indico.io
Mozilla Public License 2.0
701 stars 81 forks source link

Soft targets for sequence labeling models (with use_crf=False) #585

Open madisonmay opened 4 years ago

madisonmay commented 4 years ago

Proposed API:

X = ['sample text']
Y = [[{'start': start, 'end': end', 'label': {'key': 0.9 'key2': 0.1}}]]
model = SequenceLabeler()
model.fit(X, Y)
madisonmay commented 4 years ago

See also: https://github.com/IndicoDataSolutions/finetune/blob/development/finetune/target_models/classifier.py#L201