IBM / UQ360

Uncertainty Quantification 360 (UQ360) is an extensible open-source toolkit that can help you estimate, communicate and use uncertainty in machine learning model predictions.
https://uq360.res.ibm.com/
Apache License 2.0
257 stars 61 forks source link

Latent metric anomaly detection #24

Closed ndeutschmann closed 2 years ago

ndeutschmann commented 2 years ago

This was work in most part performed by @fcraighero while at IBM Research Zurich. It implements three algorithms for epistemic uncertainty estimation/anomaly detection based on proxies for data density in the latent space of neural networks.

It provides the following new posthocUQ methods:

The first two methods are based on k-Nearest-Neighbor searches, for which we provide three solutions

Still TODO: implementing tests (code has been checked of course though). Opening this PR to allow discussions.

pronics2004 commented 2 years ago

This is looking great!

The travis build failures should be fixed after merging the latest main branch.

Also, when you add tests, you could add the additional dependencies to .travis.yml as a temporary fix so that travis can run those tests.

ndeutschmann commented 2 years ago

I opened #27 with signed-off commits but the same content. I'm closing this