jacobeisenstein
commented
5 years ago Thanks! The PDF is currently in production, so I'll make these updates at a later stage. But I've added an errata file for now. The Melis et al paper is great, I'll see if there's still time to fit it in.
On Mon, Nov 12, 2018 at 5:35 PM Dan Oneata notifications@github.com wrote:
I've found some small typos in the chapter 6 of the notes, the version from October 21, 2018:
- Page 133, line 8: $p^\star(Duluth)$ → $p^\star_1(Duluth)$ (in order to be consistent with the probability of Francisco)
- Page 140, line -3: "a perplexities of around" → "perplexities of around"
- Page 140, equation [6.42] – the comma is in the exponent
- Page 141, line -5: "n-gramsor RNNs" → "n-grams or RNNs"
- Page 141, line -6: "character" overflows into the margin
And one suggestion: I think the article of Melis et al., On State of the Art of Evaluation in Neural Language Models https://arxiv.org/pdf/1707.05589.pdf, might be relevant for subsection 6.3.2, as it makes a strong case for hyperparameter tuning.
That said, thank you for making the notes available – they seem like a very fine resource!
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/jacobeisenstein/gt-nlp-class/issues/45, or mute the thread https://github.com/notifications/unsubscribe-auth/AA3QHLL0VPKvjQn3Mearoh17HzfW6a_Cks5uugXFgaJpZM4YaoJX .
I've found some small typos in the chapter 6 of the notes, the version from October 21, 2018:
$p^\star(Duluth)$→$p^\star_1(Duluth)$(in order to be consistent with the probability of Francisco)And one suggestion: I think the article of Melis et al., On State of the Art of Evaluation in Neural Language Models, might be relevant for subsection 6.3.2, as it makes a strong case for hyperparameter tuning.
That said, thank you for making the notes available – they seem like a very fine resource!