Nan values in model parameters

leoniekerken / ECoG-foundation-model

Self-supervised ECoG foundation model

5 stars 2 forks source link

Nan values in model parameters #30

Open zparis99 opened 2 weeks ago

zparis99 commented 2 weeks ago

For some reason there are nan values appearing in the model parameters. Figure out what's going wrong in training.

zparis99 commented 1 week ago

I have a temporary fix for this where we just skip over any examples that result in nan loss. The issue seems to come from this file: dataset_full/derivatives/preprocessed/sub-04/car/sub-04_task-part004chunk14_desc-preproc_ieeg.edf where the signal is largely a flat line so there's no frequency info. We can come up with a better long term fix later but this works for now.