search

bjascob / amrlib

A python library that makes AMR parsing, generation and visualization simple.
MIT License
216 stars 33 forks source link

Consider Adding BLINK for wiki Tag Annotations #33

Closed bjascob closed 2 years ago

bjascob commented 2 years ago

The popular way to add wiki tags today is using BLINK. Consider adding code to utilize this.

Additionally check to see if there are any updates to the Spotlight DB server and code. The java code does not run properly under Java 11 and needs to run with Java 8. Also check to see if the online servers are still running and reliable. Compare performance between BLINK and Spotlight. Obsolete this wiki tagging solution if it's not longer reasonably well supported.

The current spotlight process gives wikification smatch scores of 73 on parse_spring and 72 on parse_t5. In the parse_spring paper, "One SPRING...", they show a wikification score or 84 using the Blink model. However, note that they are applying empty :wiki tags with the model and then using post-process to fill them in. The spotlight process used currently both finds where to apply the tags and then looks them up in the DB. I'm not sure which portion (finding tag locations or finding tag values) is causing the lower scores.

bjascob commented 2 years ago

Code for WikiAdderBlink added to amrlib/graph_processing and the scripts directories for parse_t5 and parse_spring.