jasp-stats / jasp-issues

This repository is solely meant for reporting of bugs, feature requests and other issues in JASP.
59 stars 29 forks source link

Defining values for Grouping Variable... #643

Open PsyTechMMU opened 4 years ago

PsyTechMMU commented 4 years ago

Is your feature request related to a problem? Please describe. Independent-samples pairwise tests (e.g., independent t-test) cannot be computed in datasets with >2 levels in the grouping variable (without awkward workarounds).

Describe the solution you'd like Ability to define which two levels of the grouping variable are to be used in the analysis.

Describe alternatives you've considered Filtering, but it affects all analyses, and creating multiple dummy variables, but this is tedious and (should be) unnecessary.

FransMeerhoff commented 4 years ago

Hi @vandenman ,

Could you have a look at this one, or re-assign it to another? Cheers Frans

AlexanderLyNL commented 4 years ago

This should be fixed automatically with the general plans regarding data editing/filtering.

I have thought about this, but this could lead to idiosyncratic confusions, and it'll be hard to track computationally, if we fix specific filterings at specific levels of an analysis.

PsyTechMMU commented 4 years ago

Without this, is there simply no way (in a single JASP file) to conduct pairwise tests using a grouping variable with >2 values?

AlexanderLyNL commented 4 years ago

You can do an ANOVA, and if you planned certain comparisons, you can add contrasts. If you did not plan them, you can do post-hoc tests, and the advantage is that you can correct for multiple comparisons. However, I don't think that post-hoc tests have much inferential meaning other than being exploratory.

PsyTechMMU commented 4 years ago

You can do an ANOVA, and if you planned certain comparisons, you can add contrasts. If you did not plan them, you can do post-hoc tests, and the advantage is that you can correct for multiple comparisons. However, I don't think that post-hoc tests have much inferential meaning other than being exploratory.

Thanks for replying and suggesting that option, but it's really not the same thing. One of the main use-cases for this feature wouldn't even involve ANOVA e.g., just a simple independent-samples t-test between two groups (when the grouping variable includes >2 different values).

(By the way, there's no option for contrasts to be corrected for multiple comparisons, is there?)

tomtomme commented 10 months ago

@PsyTechMMU If you do a custom contrast along the ANOVA, you can select the two levels you want to compare. And there would be no need for a p-value correction then if you do only one such comparison.

However, for teaching purposes, I see this feature request as beneficial. Because the math of a t-Test is so much simpler, it is still standard to teach it. Otherwise we would just start with teaching ANOVA or GLM. And SPSS has proven, that it can be done. There you can select which 2 levels to compare, without filtering etc.