Integrate more NER datasets (outdated, removed) - Githubissues

DFKI-NLP / fewie

Few-shot named entity recognition

MIT License

11 stars 1 forks source link

Integrate more NER datasets (outdated, removed) #2

Closed chen-yuxuan closed 3 years ago

chen-yuxuan commented 3 years ago

Datasets to be integrated in addition to CoNLL2013:

English datasets

[ ] Few-NERD
- paper, repo
[ ] OntoNotes 5.0
- download
[ ] WikiGold
- paper
[x] WikiAnn
- huggingface
- splits: train (20000), validation (10000), test (10000)
- features: tokens, ner_tags, langs, spans
[x] WNUT17
- huggingface
- splits: train (3394), validation (1009), test (1287)
- features: ids, tokens, ner_tags
[ ] I2B2
- paper
[ ] Lenovo Products (ask Leo)

German datasets

[x] GermaNER
- huggingface
- splits: train (26200)
- features: ids, tokens, ner_tags
[ ] Smartdata
- repo
[ ] Daystream
- repo

Optional datasets

[ ] MIT Movie
[ ] MIT Restaurant
[ ] SNIPS
[ ] ATIS