0todd0000 / spm1d

One-Dimensional Statistical Parametric Mapping in Python
GNU General Public License v3.0
61 stars 21 forks source link

Outliers #51

Closed zof1985 closed 8 years ago

zof1985 commented 8 years ago

Hi Todd,

I would like to know your opinion about the outliers detection prior to calculate of the statistical parameteric maps. Particularly, I wonder if the use of a multivariate outliers detection technique such as the minimum covariance determinant approach might be useful in detecting those cases (i.e. rows in the data matrix) that appear significantly different from the others. Accordingly, I would also know your opinion about how to handle the detected outliers, especially within a repeated-measures analysis.

Thanks, Luca.

0todd0000 commented 8 years ago

Hi Luca,

This issue is a bit difficult to respond to directly because outlier detection and exclusion is somewhat controversial and because SPM does not solve any of those controversies. Nevertheless, univariate and multivariate outlier detection is possible in SPM through typical procedures applied on a point-by-point basis to produce a test statistic continuum (e.g. the Grubbs test statistic). As long as a test statistic can be computed for 0D univariate or multivariate data then it can be applied directly to 1D univariate or multivariate data.

There are a number of papers which deal with the outlier issue including:

My personal feeling is that qualitative detection of outliers is fine provided (a) something clearly went wrong with data collection, and/or (b) you report results both with and without the apparent outliers. If apparent outlier exclusion qualitatively affects your results then you should probably explore and report why. An alternative approach would be to compare parametric and non-parametric results; if there are no qualitative differences in the results then the apparent outliers likely do not violate parametric assumptions.

Cheers, Todd

zof1985 commented 8 years ago

Than you very much.