How to use bi-encoders to achieve Chinese entity linking on your own data set (including entity recognition)

facebookresearch / BLINK

Entity Linker solution

MIT License

1.17k stars 231 forks source link

How to use bi-encoders to achieve Chinese entity linking on your own data set (including entity recognition) #71

Open Grace-Wang-Lab opened 3 years ago

Grace-Wang-Lab commented 3 years ago

The function I want to achieve is to give a piece of Chinese text and find the best candidate entity from my entity database.Can you write a document describing how to implement this process. As a novice, I don't know much about the process and I hope to get help. @fabiopetroni

abhinavkulkarni commented 2 years ago

@Grace-Wang-Lab: It is indeed possible to train a model on your own custom dataset. I would recommend first training a zeshel (Zero-shot learning) model, then bring your data in the same format as zeshel and train your model.

Scripts to download and pre-process zeshel data set are in the repository.