Closed bruffridge closed 3 years ago
It would be very useful to show the "learning curve" for our training efforts. So start with a subset of papers, train, see results. Add more papers and repeat. Keep adding and repeating and see the plot. Is accuracy improving ? How rapidly?
Done. https://github.com/nasa-petal/PeTaL-labeller/tree/main/auto-labeler/MATCH#effect-of-training-dataset-size-on-match-precision
It would be very useful to show the "learning curve" for our training efforts. So start with a subset of papers, train, see results. Add more papers and repeat. Keep adding and repeating and see the plot. Is accuracy improving ? How rapidly?