search

TengMCing / lineup_residual_diagnostics

A Plot is Worth a Thousand Tests: Assessing Residual Diagnostics with the Lineup Protocol
1 stars 0 forks source link

JCGS reviewer 2: (5) cultural biases #8

Closed TengMCing closed 11 months ago

TengMCing commented 1 year ago

Reviewer 2: "At the beginning of Section 4.2.3, what cultural biases do the authors anticipate by restricting the participants to be 'fluent in English'? Granted this is likely done as a matter of convenience, but it would be good to articulate how cultural biases may be present in interpreting a lineup protocol."

TengMCing commented 1 year ago

We did apply filters on potential participants. The reason we restrict the participant to being "fluent in English" is the experiment website is not multilingual. Designing a multilingual website may introduce extra factors such as the accuracy of the translation.

It is actually difficult to know what cultural biases may be present because of this restriction. We need to have a discussion on this.