search

meeg-ml-benchmarks / brain-age-benchmark-paper

M/EEG brain age benchmark paper
https://meeg-ml-benchmarks.github.io/brain-age-benchmark-paper/
BSD 3-Clause "New" or "Revised" License
24 stars 10 forks source link

Adding results and figures for DL benchmarks #35

Closed hubertjb closed 2 years ago

hubertjb commented 3 years ago

Here is the first complete set of results for DL benchmarks. These results were obtained using the current main branch (commit 8706ad6f7699ac53996a1bf9e8379892840b3ad2). @dengemann @gemeinl

Some key points:

  1. Cropped decoding was used.
  2. Input windows were normalized dataset-wise using the standard deviation over all examples of a dataset.
  3. No PCA projection was used on Cam-CAN, as standardizing the data already provided good results.
  4. No hyperparameter optimization was used for producing these results; the default values provided by @gemeinl were used. Similarly, no early stopping was done; instead the models were trained for 35 epochs with cosine annealing of the learning rate.

image

dengemann commented 3 years ago

Amazing!! Great work. Looking forward to discussing tomorrow.

On Wed, 17 Nov 2021 at 22:15, Hubert Banville @.***> wrote:

Here are the first complete set of results for DL benchmarks. These results were obtained using the current main branch (commit 8706ad6 https://github.com/dengemann/meeg-brain-age-benchmark-paper/commit/8706ad6f7699ac53996a1bf9e8379892840b3ad2). @dengemann https://github.com/dengemann @gemeinl https://github.com/gemeinl

Some key points:

  1. Cropped decoding was used.
  2. Input windows were normalized using the standard deviation over each dataset.
  3. No PCA projection was used on Cam-CAN, as standardizing the data already provided good results.
  4. No hyperparameter optimization was used for producing these results; the default values provided by @gemeinl https://github.com/gemeinl were used. Similarly, no early stopping was done; instead the models were trained for 35 epochs with cosine annealing of the learning rate.

[image: image] https://user-images.githubusercontent.com/6500858/142283446-6dc87a95-9c46-4ecb-b14f-3d1bac8e82c0.png

You can view, comment on, or merge this pull request online at:

https://github.com/dengemann/meeg-brain-age-benchmark-paper/pull/35 Commit Summary

File Changes

(14 files https://github.com/dengemann/meeg-brain-age-benchmark-paper/pull/35/files )

Patch Links:

- https://github.com/dengemann/meeg-brain-age-benchmark-paper/pull/35.patch

https://github.com/dengemann/meeg-brain-age-benchmark-paper/pull/35.diff

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/dengemann/meeg-brain-age-benchmark-paper/pull/35, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAOR7CXCB23XDALJZ3SY6PTUMQLPXANCNFSM5IIAH3ZQ .

gemeinl commented 3 years ago

Thx for uploading @hubertjb Perfect summary as well, I have nothing to complain / add.