burklight / convex-IB-Lagrangian-PyTorch

3 stars 0 forks source link

Math Formula Error #3

Open Mutual-Luo opened 9 months ago

Mutual-Luo commented 9 months ago

Thank you for your code! But do you think there exists errors in the derivation of mathematical formulas [Eqs.(10) in https://arxiv.org/pdf/1705.02436.pdf]

Authors cite paper "Estimating mixture entropy with pairwise distances". The author of this article has corrected his thesis error. image

But "nonlinear information bottleneck" still use the still using the wrong math conclusions. [I don't think the last two items can be omitted] image

Is there some principle that I don't understand or it's a mistake?

burklight commented 9 months ago

Thank you for your comment. Good point, please check the answer from Artemy here (https://github.com/burklight/nonlinear-IB-PyTorch/issues/2#issuecomment-1896207351).