Calculate confidence and center of attention

liebharc / homr

homr is an Optical Music Recognition (OMR) software designed to transform camera pictures of sheet music into machine-readable MusicXML format.

GNU Affero General Public License v3.0

9 stars 3 forks source link

Closed liebharc closed 4 months ago

liebharc commented 4 months ago

Might help us towards https://github.com/liebharc/homr/issues/2 or just to develop a better understanding of how the transformer model works.

This PR calculates additional meta values from the transformer network:

Confidence: How certain is the network about its prediction
Attention: Which area of the image got most attention during the prediction, this should relate to the position of the symbol