kermitt2 / entity-fishing

A machine learning tool for fishing entities
http://nerd.readthedocs.io/
Apache License 2.0
241 stars 24 forks source link

New ranking model based on BLINK biencoder/crossencoder approach? #101

Open oterrier opened 4 years ago

oterrier commented 4 years ago

Hi Patrice, Facebook recently released BLINK https://github.com/facebookresearch/BLINK https://arxiv.org/abs/1911.03814 This is a novel approach for entity linking based on BERT transformers that apparently outperform even the already impressive DeepType (Raiman & Raiman) Maybe we could try to implement the ranking/selection of Entity fishing using this approach, what do you think?

Best regards Olivier

kermitt2 commented 4 years ago

Hi Oliver, thanks !

Not sure that it's more interesting than DeepType:

However, it would be really nice to add several approaches to reproduce and test them, and indeed BLINK would be something good to test. I think their implementation relying on SOLR would be too slow for general entity disambiguation (I initially implemented an ElasticSearch IR-approach, but this is just far too slow to process complete documents with all Wikidata for all entity mentions).

kermitt2 commented 4 years ago

Also, as a memento, nice to follow: https://github.com/izuna385/EntityLinking_RecentTrend