search for different architecture choices and evaluate (theoretically) whether they'd be suitable for our task. collect pro / contra arguments. keep the runtime (realtime!) in mind.
example architectures:
LSTM
GRU
Transformer
RetNet (Retentive Network)
Mamba ?
3D Conv
two-stage detector: first detect sequence begin, then classify sequence
search for different architecture choices and evaluate (theoretically) whether they'd be suitable for our task. collect pro / contra arguments. keep the runtime (realtime!) in mind.
example architectures: