wcmac / sippycup

SippyCup is a simple semantic parser, written in Python, created purely for didactic purposes.
GNU General Public License v2.0
218 stars 72 forks source link

Accuracy based on the best parse #6

Closed cgpotts closed 6 years ago

cgpotts commented 6 years ago

This small change should help bring the accuracy results reported during training into better alignment with what we see at test time. The change just involves assessing based on the best current parse rather than the currently predicted one. I think the currently predicted one isn't really optimal because of the noisiness of SGD updates. Testing against the current best parse is more like what happens during testing.