Experiments before final experiments

[cosmaadrian]

• [x] Exploring different schedulers & learning rates for the baseline model
• [x] Check if the perceiver is learning something, check if the same batch size works for it
• [x] Ablation study on number of windows for perceiver, check if it works
• [x] Small ablation on presence_threshold, maybe lower is better (more data), or maybe higher is better (more quality)
• [x] Ablation on the modalities. Which combination works better?