perplexity aggregation scheme

mila-iqia / blocks

A Theano framework for building and training neural networks

Other

1.16k stars 351 forks source link

perplexity aggregation scheme #1190

Closed rizar closed 7 years ago

rizar commented 7 years ago

This PR does two nice things: (a) improves the test of the Mean aggregation scheme to check what actually happens when batch sizes are different (b) adds and tests a Perplexity scheme, which in fact was the original motivation for the aggregation schemes 2 years ago..

@dmitriy-serdyuk , can you please review this?

rizar commented 7 years ago

Your only comment was addressed, can you please look again?

dmitriy-serdyuk commented 7 years ago

Ok, LGTM.