In the paper in https://arxiv.org/pdf/1904.08364.pdf sec 3.2 it is mentioned:
"We borrow the concept of cross-entropy from information theory, which is designed to measure the “distance” between two probability
distributions."
Wont' kl-divergence be a better way to measure the distance between both probability distributions ?
In the paper in https://arxiv.org/pdf/1904.08364.pdf sec 3.2 it is mentioned: "We borrow the concept of cross-entropy from information theory, which is designed to measure the “distance” between two probability distributions."
Wont' kl-divergence be a better way to measure the distance between both probability distributions ?