NOCIONS / letswave6

Letswave 6 - Matlab EEG signal processing toolbox
www.nocions.org/letswave6
48 stars 30 forks source link

Different results with LW6 and LW7 #150

Open valebrown opened 6 years ago

valebrown commented 6 years ago

Good morning, I always used LW6, but recently I've started to use the new release of LW7 because it is faster. Today I performed a paired sample t-test (1000 permutations, cluster threshold 0.05) with LW7, but I obtained different results from the ones obtained with LW6 (1000 permutations, alpha level 0.05, cluster threshold 95) on the same datasets.

The t-value and p-value waves are the same with LW6 and 7, only the cluster t-value and cluster p-value are different. Here I attach the two figures for better understating: T-value (both the waves are plotted, but they are overlapping) image

and here the cluster T-value image

Do you know why they are different, even if the number of permutation testing is the same?

Thank you, valentina

hughherald commented 6 years ago

Dear Valebrown, Since the random factor in the Permutation test, the result would be different for every time of running. If you want to have a stable result, increasing the permutation times would be a efficient way, which would also increases the running time.

Best, Gan Huang