Closed yifding closed 2 years ago
Thanks for pointing out the mistakes in readme for me! I've never tried "rel" with Gerbil, so I have no idea why you met those problems with the provided gerbil snapshot. From my experience on EntQA, Gerbil usually reports slightly higher performance than running local evaluation on AIDA test. While you're running "gerbil_experiments/server.py", Gerbil will feed a raw text passage to my model each time, my model will output a list of (start_idx, end_idx, entity_name) for that raw text passage to Gerbil. After the experiment is finished, you can find the experiments results on "http://localhost:1234/gerbil".
Thank you!
Hello, really nice work:
I have a few questions/corrections/suggestions to reproduce the gerbil results.