Open jameshowison opened 6 years ago
Bootstraping software mention detection:
Pan, X., Yan, E., Wang, Q., & Hua, W. (2015). Assessing the impact of software on science: A bootstrapped learning of software entities in full-text papers. Journal of Informetrics, 9(4), 860–871. https://doi.org/10.1016/j.joi.2015.07.012
They use a white list of software names to find mentions then train machine learning with that. Because they don't have a gold standard set they don't have a way of knowing what mentions they might have missed.
RQ: can we reduce the amount we read and still find sufficient software mentions?
In the GROBID entity recognition modules and entity-fishing, in particular for recognizing scientific quantities, astronomical entities and named entities, we use a different bootstrapping approach which is machine learning-driven:
The motivation is that machine learning is super sensitive to the quality of training data. If we train with incomplete/erroneous training data, we have bad results. It's more efficient to train with very small high quality training data than with a lot of incomplete/low quality annotated data (as we could get with a simple white list of software names).
The second reason is to ensure that the training data, here XML, is exactly aligned with the content of the PDF given the tool that will then process the PDF. Cut and paste of PDF raises problems, because the copied text will depend on the PDF viewer (which is changing the order of PDF elements as compared to the PDF element stream order). The latest macOS PDF viewer for instance post-processes significantly the content of the PDF (recomposing characters and even performing some OCR to solve placeholder UTF-8 codes for embedded glyphs).
https://public.etherpad-mozilla.org/p/bootstraping_planning