Add end of the study questionnaire to the end of study phase

[arielle68]

Hi,

The end of study questionnaire should be administered at the end of the Week 12 assessment.

Here is the link to its spec : https://docs.google.com/document/d/1-i38wwb_gafED-0INQ0-YVdq12Eef17_pVg0OHPlpEE/edit?usp=sharing

Thanks

[maramather]

Let's put this into Qualtrics. Kaoru, would you ask a team member to use the spec linked above to create a Qualtrics questionnaire?

Noah, once we have a Qualtrics questionnaire, could you make sure they get routed to complete it at the end of the post-study assessment?

[noah10]

Note to whoever is creating the qualtrics questionnaire: Please set it up to have an embedded data field named "huid". I'll use that to pass the human (7 character) user id. And yes, I'll set something up to forward users to the qualtrics link once they finish the post-study assessment.

[nashiro]

Mara, could we ask Padideh? @arielle68 would it be possible to create a Qualtrics questionnaire, as Mara and Noah request above?

[nashiro]

Paul just told me: "Hi Kaoru, I think Christine already created this on Qualtrics. It’s in Post-Study Questionnaire under Heartbeam study." Qualtrics Link : https://usc.qualtrics.com/jfe/form/SV_40fyXTh4ErOBePc

Paul said he will set it up to have an embedded data field named "huid" as Noah requested. Thanks Paul! @choipaul92

Padideh, @arielle68 please disregard my request above.

[choipaul92]

Embedded data field is set on qualtrics and I tested it out manually & it worked. @noah10 , let me know when I can test this out (i.e. auto email with the link)

Link: https://usc.qualtrics.com/jfe/form/SV_40fyXTh4ErOBePc

[noah10]

We won't be emailing it; we'll simply send people to it when they finish the final task in set 12. Which brings up a question: Do we want to show people the "You're all done" screen and have them click a button to go to the survey, or just have them get launched straight from the last image in pattern-separation-recall (which is the final task in set 12) to qualtrics?

[nashiro]

If people see the "You're all done" screen, they may not complete the survey. Would it be possible to change the text to something like "Please click a button to complete the final task"?

Mara probably has a better suggestion. @maramather

[maramather]

I like the option "have them get launched straight from the last image in pattern-separation-recall (which is the final task in set 12) to qualtrics". The end of the qualtrics study can tell them congratulations and thank them for completing the study.

[nashiro]

Thanks Mara. Noah, can you go with Mara's suggestion?

[noah10]

OK - this is up on dev and ready to be tested. You can test it by going to https://dev.heartbeamstudy.org/daily-tasks/?tasks=pattern-separation-recall&setNum=12 . Note the following:

• I'm using the same qualtrics link on dev and prod, so if you fill out the survey on dev your answers will (presumably) be mingled with the answers from actual participants
• I didn't fill out the survey, so I don't know if it displays the "thanks and congratulations" message that Mara wanted users to see at the end

@nashiro I'm not sure who should test this, so I'm assigning it to you for now. Feel free to re-assign to someone else, of course.

[choipaul92]

Tested it out and looks good. After the last task (pattern separation task), the post survey questionnaire is given right away. It's important to note that the survey does not have any "forced requirements" so participants can leave it blank.

[cho890]

I just tried to test this but was not taken to the end of study questionnaire. After completing the pattern separation task, I saw the below screenshot:

[noah10]

@cho890 - I'm not 100% sure, but I think the reason you got that is because you already have a set-finished record for set 12 in dev. (Assuming that you're using the cho890 account there.) Shall I mess with your data so that it doesn't look like you've already finished set 12?

[cho890]

I used the christine.cho account to test this, not the cho890. I don't recall testing set 12 in dev, though I could be mistaken. If that is the cause, then I don't see a problem with deleting it so I can test this open issue.

[maramather]

Paul - could you make Q1-7 required?

[maramather]

We need to do better on the completion congratulations message. Does Qualtrics allow us to put a graphic there?

[cho890]

The change from completing the pattern separation task to the survey is rather abrupt. Should we add a transition in between these two or a message at the top of the survey? Also, for me, questions 1-8 require a response. I cannot advance without answering these questions. Do we want to force responses?

[maramather]

I agree, a transition message would be good. @cho890 what do you think of "Amazing work! You have finished all of our study except for a few wrap-up questions. Please fill those out here now. We are very interested in your thoughts and feedback!"

Yes, I would like to force response for Q1-7 where we will need to report those for the study to (hopefully) convince reviewers that the two conditions were similar.

[noah10]

Does that message go at the top of the survey? If not, how do they get from the transition message to the survey?

[maramather]

Yes, it should be possible to put the message at the top of the survey, where instructions would normally go. @choipaul92 let us know if not.

[cho890]

We can add it to the top of the survey, and put the instructions below it. I like the message you proposed, @maramather. I made a few edits; would this work? "Amazing work! You have finished all of our study, and we are very interested to hear about your overall experience. Please fill out the short survey below to share your thoughts and feedback about the study."

[maramather]

That sounds like they are done with the study and the survey is optional. It should not be optional - it is an important part of the study.

[cho890]

@maramather Following up from our conversation, how does this sound? "Amazing work! You are nearly finished with the study, and you have one final survey to complete. Please fill out the short survey below to share your overall experience in the study. We are very interested in your thoughts and feedback!"

[maramather]

sounds great to me!

[cho890]

@maramather @choipaul92 I modified the message at the beginning of the survey and added a congratulatory message at the end. I think the congratulatory message could use one more sentence, perhaps about the final payment? Please let me know what you think.

[maramather]

Yes, I think the congratulatory message regarding the questionnaire should be followed by an overall study thank you message. Something like a new line and "And congratulations on completing the entire study! It is an impressive accomplishment and we thank you for your help in investigating how paced breathing may help accelerate learning. We will be mailing you the final compensation check for your participation soon."

Also, on the survey, please make "If the amount of effort changed over the course of the brain games and/or breathing practice, please explain how it changed:"

and "In particular, which aspects of the brain games and/or breathing practice do you think you would be likely to continue to practice?"

optional questions (they should not have to fill these out to continue)

[cho890]

@maramather Sure! I've added your edits to the congratulatory message and made those 2 questions optional.

[choipaul92]

Just checked and all updates were in place (including Q1-7 being forced and the two questions above being optional as well). The abrupt transition still is there.

[noah10]

By "abrupt transition" do you mean that it just goes immediately from the final task to the survey? If so, the solution for that was to add the "Amazing work, you are nearly finished" message to the top of the survey - see https://github.com/EmotionCognitionLab/pvs/issues/337#issuecomment-1483201585 . @maramather , assuming that that's still the way you want it, are there any other changes needed here or should it be pushed to production?

[cho890]

Correct, we have added the transition message to the top of the survey. This issue can be closed.

[noah10]

This has been deployed to production.