search

explosion / spacy-llm

🦙 Integrating LLMs into structured NLP pipelines
https://spacy.io/usage/large-language-models
MIT License
1.03k stars 81 forks source link

Active learning NER #364

Open tianchiguaixia opened 8 months ago

tianchiguaixia commented 8 months ago

For example, I want to take a space_ Llm, perform NER auxiliary annotation. With my corrections and updates, how can I let the model know more information and actively learn

rmitsch commented 8 months ago

Hi @tianchiguaixia! If your goal is to perform active learning, LLMs are likely not the way to go at this point. Instead you might want to look into active learning with smaller models.

Prodigy is an annotation tool that is build around this idea, I recommend checking it out.

tianchiguaixia commented 8 months ago

Can we achieve something similar https://github.com/HumanSignal/Adala

rmitsch commented 7 months ago

Adala and Prodigy have overlapping, but not identical, feature sets. It depends on what exactly you want to achieve.

tianchiguaixia commented 7 months ago

I recently tried spacy_ LLM and prodigy. Very good!This prodigy is exactly the kind of proactive learning I want

https://github.com/explosion/spacy-llm/assets/29837553/fc796f2d-69bb-4f96-88a7-d5ab2e47324c