Could you please explain the equation 1 in your technical report?

kedartatwawadi / NN_compression

MIT License

212 stars 42 forks source link

Could you please explain the equation 1 in your technical report? #10

Closed sonack closed 5 years ago

sonack commented 6 years ago

Why there is an addition with 2/N ?

kedartatwawadi commented 5 years ago

The 2/N is due to bounds on the performance of arithmetic coding. More information is in the cited reference (Cover, Thomas Elements of Information Theory'.

You can also take a look here (section 6.2) https://web.archive.org/web/20070630050721/http://www.inference.phy.cam.ac.uk/itprnn/book.pdf