pytorch / ignite

High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.
https://pytorch-ignite.ai
BSD 3-Clause "New" or "Revised" License
4.5k stars 608 forks source link

Add MutualInformation Metric #3230

Closed kzkadc closed 3 months ago

kzkadc commented 3 months ago

Description: added MutualInformation metric, which is often used in representation learning.

It measures the mutual information between input and output for classification models.

Check list:

vfdev-5 commented 3 months ago

@kzkadc thanks for the PR adding more metrics ! I left few comments to check