langcog / web-cdi

7 stars 5 forks source link

Add 'compliance check' questions as optional study feature #258

Closed benjamindemayo closed 4 years ago

benjamindemayo commented 4 years ago

To ensure high data quality, we would like to implement a change that allows researchers to ask certain demographics at both the beginning and end of the survey. Namely, we would like participants to enter the mother's birth year and the child's birth weight at both the beginning and end so that we can filter out participants with discrepancies between their answers to these two questions. @vmarchman, can you please weigh in on whether you want payment to be contingent on answering these compliance questions consistently? I don't have a good sense of how difficult that is to implement.

HenryMehta commented 4 years ago

@benjamindemayo, @vmarchman What are the criteria which trigger this action? Is it based on a current checkbox in the study settings or is this a new setting. What happens if they don't match? Do you want the parent to be able to correct or continue saving the two different values? If you're not paying when not correct are parents getting the opportunity to correct (and how many opportunities)

HenryMehta commented 4 years ago

Following conversation with Virginia

HenryMehta commented 4 years ago

This is available to test. I can't do the toggle

benjamindemayo commented 4 years ago

Hi Henry, I just tested English WG2 on dev, I'm not seeing the changes you've implemented - am I testing the wrong thing?

On Thu, Apr 16, 2020 at 5:40 AM Henry Mehta notifications@github.com wrote:

This is available to test. I can't do the toggle

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/langcog/web-cdi/issues/258#issuecomment-614627165, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEZFMHPI7FRZFZGIGYCCNQDRM34CZANCNFSM4MII3XWA .

-- Benjamin E. deMayo Lab Manager Language and Cognition Lab Department of Psychology Stanford University

benjamindemayo commented 4 years ago

I see - I was unclear in my original request.

What we want here is to ask two of the demographic questions both on the first and last page of the survey. These are:

So, when the participant clicks the link, they will be taken to a landing page with the following demographic questions:

1) Who is filling out the form? 2) Child DOB 3) Age (in months) (this field autocompletes) 4) Sex 5) Country 6) Primary caregiver date of birth 7) Child's birthweight.

Then, once the parent has finished the survey and is on the final page, they are asked all the demographic questions currently on that page, including a repeat of 6) Primary caregiver date of birth and 7) Child's birthweight from the first page. These repeated questions should not be highlighted in any way on either the first or last page, and the participant should not be alerted if they enter a different response on the last page of the survey that they did in the first page.

HenryMehta commented 4 years ago

ok. I have diverticulitis and I have had a bout start to play up. I'm not going to work today while I try and recover unless I start felling a lot better later. I'll pick up over the weekend

vmarchman commented 4 years ago

Sorry to hear that, Henry! Feel better soon!

On Fri, Apr 17, 2020 at 12:08 AM Henry Mehta notifications@github.com wrote:

ok. I have diverticulitis and I have had a bout start to play up. I'm not going to work today while I try and recover unless I start felling a lot better later. I'll pick up over the weekend

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/langcog/web-cdi/issues/258#issuecomment-615081980, or unsubscribe https://github.com/notifications/unsubscribe-auth/AB2TUTGFVEUSROXDRXLRE6LRM755DANCNFSM4MII3XWA .

benjamindemayo commented 4 years ago

Oh my goodness, feel better. My mom has had that many times, I know it can be really unpleasant. Take care!

Sent from a mobile device, please excuse typos or brevity.

On Fri, Apr 17, 2020, 7:23 AM Virginia Marchman notifications@github.com wrote:

Sorry to hear that, Henry! Feel better soon!

On Fri, Apr 17, 2020 at 12:08 AM Henry Mehta notifications@github.com wrote:

ok. I have diverticulitis and I have had a bout start to play up. I'm not going to work today while I try and recover unless I start felling a lot better later. I'll pick up over the weekend

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/langcog/web-cdi/issues/258#issuecomment-615081980, or unsubscribe < https://github.com/notifications/unsubscribe-auth/AB2TUTGFVEUSROXDRXLRE6LRM755DANCNFSM4MII3XWA

.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/langcog/web-cdi/issues/258#issuecomment-615272879, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEZFMHINXGZEZ3VRGDFBYILRNBQ4JANCNFSM4MII3XWA .

HenryMehta commented 4 years ago

@benjamindemayo @vmarchman Deploying amendments now - please give 20 mins before testing