JuliaDynamics / ComplexityMeasures.jl

Estimators for probabilities, entropies, and other complexity measures derived from data in the context of nonlinear dynamics and complex systems
MIT License
48 stars 11 forks source link

Feature: "attention entropy" #387

Open kahaaga opened 5 months ago

kahaaga commented 5 months ago

The "attention entropy" does essentially the following:

This can be implemented as an OutcomeSpace. Maybe MotifSpacing is a good name? This method is generalizable to any sort of pattern spacing. It is just a matter of encoding differently. An easy way to do so is just to dispatch on MotifSpacing(::Pattern), where Pattern could be MinMaxSpacing, MaxMinSpacing, MaxMaxSpacing, MeanMeanSpacing, MedianMedianSpacing, MedianQuantileSpacing, etc.

It will not be straight-forward to decode/encode. However, codify can be implemented: it simply returns the encoded time series y.