Transformers to try:

[Aramist]

• [x] Various sparse transformer architectures
• [x] Crop input to a single 1ms segment
• [x] Block input into many independent fixed-length segments