Create a model_validation module - Githubissues

NeuroTechX / moabb

Mother of All BCI Benchmarks

https://neurotechx.github.io/moabb/

BSD 3-Clause "New" or "Revised" License

646 stars 168 forks source link

Create a model_validation module #612

Open bruAristimunha opened 1 month ago

bruAristimunha commented 1 month ago

The final goal is to flat all the evaluations, but the first step will be to create the spitters:

Here, we have some examples with braindecode and benchopt:

https://github.com/benchopt/benchmark_bci/blob/main/benchmark_utils/splitter.py

It is necessary to create the following spitters:

WithinSessionSplit
CrossSessionSplit
CrossSubjectSplit

Two meta splitters:

TimeSeriesSplit; (Pseudo-Online)
SamplerSplit (Fraction of the split) http://moabb.neurotechx.com/docs/auto_examples/learning_curve/plot_learning_curve_motor_imagery.html

Many tests are necessary to ensure that we have the same split.

bruAristimunha commented 4 weeks ago

Hey @brunaafl,

Some deadlines for you:

Create the draft PR (07/06/2024);
Create the tests (07/06/2024, maximum 11/06/2024)
Integrate the PR (14/06/2024)