external research- choose relevant reporter + submit relevant UID [6h]

[noamoss]

1. simplify pre-questions [1h]

א) לאחד את שתי השאלות לגבי המחקר הנוסף לשאלה אחת כי אנשים נופליפ ביניה

omit the first general research question [0.5h]

2. choose specific reporter and submit uid to the google form [3h]

ב) לוודא עם המשתמש עבור מי ממלאים את השאלון הנוסף

a. when the user clicks 'yes', to fill the external questionnaire, before opening the external research link, ask:

q: "עבור מי מהמדווחים תמלאו את השאלון?"

b. submit the reporter uid to the relevant field in the form

3. update the "end of report text" [1h]

ג) לעדכן את הניסוח לגב סיום מילוי לבני הבית, כי אנשים חושבים שסיימו לגמרי וסוגרים את הדפדפן

this part will not be applied before getting suggestions from the client ( cc @dorit102 )

[noamoss]

@akariv please approve/update my time estimation. If it seems ok, just remove the label and it is ready to apply.

[akariv]

For (2) we have what we planned for #190 - ask for each reporter 'is it you or someone else' (and stop asking once we get a 'yes' to that question. For (3) - I think that's already done.

Other than that estimations seem fine.

[noamoss]

(2) WSI staff prefers a single selection question, to choose the reporter (like we doing the end of the loop). Can you te the time/price differences between the two options?

(3) so did I (cc @dorit) and therefore asked for an explicit definition of an alternaive text.

On Mon, May 25, 2020, 9:08 AM Adam Kariv notifications@github.com wrote:

For (2) we have what we planned for #190 https://github.com/hasadna/avid-covider/issues/190 - ask for each reporter 'is it you or someone else' (and stop asking once we get a 'yes' to that question. For (3) - I think that's already done.

Other than that estimations seem fine.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/hasadna/avid-covider/issues/337#issuecomment-633395193, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA3KOLISTTIK5LUOJAASP6DRTIDOJANCNFSM4NJAA7PQ .

[noamoss]

@akariv

They still prefer a a single selection question, we verified it today.This is the deinition (1-3, did not touch the description, to prevet confusion):

"ומה עכשיו...?" א. סיימתי, ואני מעונין גם לענות על שאלות לגבי תחושת לחץ ומצב רוח ב. סיימתי להיום, אינני מעוניין לענות על שאלות נוספות

if yes:

מדובר במחקר של פרופ' אלון חן ממכון ויצמן בנוגע לתחושת לחץ באוכלוסיה. מי ישיב על השאלון? (בלחצנים שמעבירים לגוגל) -בת 46 מאליקום -בן 49 מאליקום -אולי בפעם אחרת

(each click will submit to the google form the relevant uid)

[akariv]

I don't like that we're removing the 'don't ask me again' option.

On Tue, May 26, 2020 at 8:11 PM noamoss notifications@github.com wrote:

@akariv https://github.com/akariv

They still prefer a a single selection question, we verified it today.This is the deinition (1-3, did not touch the description, to prevet confusion):

"ומה עכשיו...?" א. סיימתי, ואני מעונין גם לענות על שאלות לגבי תחושת לחץ ומצב רוח ב. סיימתי להיום, אינני מעוניין לענות על שאלות נוספות

if yes:

מדובר במחקר של פרופ' אלון חן ממכון ויצמן בנוגע לתחושת לחץ באוכלוסיה. מי ישיב על השאלון? (בלחצנים שמעבירים לגוגל) -בת 46 מאליקום -בן 49 מאליקום -אולי בפעם אחרת

(each click will submit to the google form the relevant uid)

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/hasadna/avid-covider/issues/337#issuecomment-634156833, or unsubscribe https://github.com/notifications/unsubscribe-auth/AACAY5PICRMUCORJADIC233RTPZ3HANCNFSM4NJAA7PQ .

[noamoss]

@akariv I agree - but it seems like both teams are seeing both parts as a related research data set. In this offer the user get an explanation about the relevancy of the external research to the data they just provided and we don't add a question - they ca finish their report without jumping in or reading about the other research if they don't want to (in other words, they don't pay in their attention unless they are interested doing so). It combined the end report and the extra_research question

[noamoss]

@akariv

QA Finding 1:

מי ישיב על השאלון?

-->

מי מכם ישתתף במחקר?

[noamoss]

@akariv

Qa finding 2:

finished an initial report for a first user on a device. Later (a couple of days later) I created a new reporter on the same address - but only one option was given to choose:

The following screenshot was taken later (after a refresh) to show two reporters still exist in the device:

[noamoss]

@akariv

QA finding no. 3:

update loop question:

"זהו להיום" --->

"כולם דיווחו"

see finding 7 below, related to this one.

[noamoss]

@akariv QA finding 5:

after creating a user with a different address on the same device the new question

shows no options and freezes the chat:

(device reporters:)

[noamoss]

@akariv

QA finding 6:

no " אולי בפעם אחרת" option in the new choose reporter question - this option should practically enable users to take a backward step to keep me in the current site/chatbot.

[noamoss]

@akariv finding 7 which should be handled together with finding 3:

questions order should be different:

• after choosing "כולם דיווחו" (finding 3):
  1. "ומה עכשיו...?" א. סיימתי, ואני מעונין גם לענות על שאלות לגבי תחושת לחץ ומצב רוח ב. סיימתי להיום, אינני מעוניין לענות על שאלות נוספות

2a. if A --> choose which reporter and lead to the external research 2b. if B --> offer reminder and share

[akariv]

QA Finding 1: But... https://github.com/hasadna/avid-covider/issues/337#issuecomment-634156833 QA Finding 2: Only people that reported today appear in the list QA Finding 3: This was a recurring comment - people not pressing that as not 'everyone reported', and not getting to the next phase:

QA Finding 4: no number 4!!!! QA Finding 5: if a full day had passed (i.e. a minute on staging), the list of today's reporters will be empty. This is an edge case, not very interesting in production imo QA Finding 6: This is exactly the 'לא תודה, סיימתי' option. QA Finding 7: Why throw users out of the flow before they set a reminder? Didn't you say "It combined the end report and the extra_research question"?

[noamoss]

@akariv

QA Finding 1: But... https://github.com/hasadna/avid-covider/issues/337#issuecomment-634156833

right, but now I see that, and notice the gender effect.

QA Finding 2: Only people that reported today appear in the list

makes sense. still should enable the "אולי בפעם אחרת" options

QA Finding 3: This was a recurring comment - people not pressing that as not 'everyone reported', and not getting to the next phase:

ok - let's go with "אפשר להמשיך", anyway, it is still connected to 7.

QA Finding 4: no number 4!!!!

that was exactly the bug I found :)

QA Finding 5: if a full day had passed (i.e. a minute on staging), the list of today's reporters will be empty. This is an edge case, not very interesting in production imo

a. Is it just for a full day, or also for reporters starting at 23:55 and getting to this question on 00:02?

b. why not set a fallback rule to skip this question (and prevent similar future feedbacks on QA) if there are not active reporters on the device for the last day?

QA Finding 6: This is exactly the 'לא תודה, סיימתי' option.

not exactly, I might want to stay in the bot in the name choosing step. I know I can change my last answer, but it is not explicit enough (in this use case, I think).

QA Finding 7: Why throw users out of the flow before they set a reminder? Didn't you say "It combined the end report and the extra_research question"?

The reason? because currently, they care more about collecting more data (and combine it) than encouraging the user to become a returning reporter and/or share. I think it is a mistake, and assume it will be changed in case of a massive need for symptoms report.

by "end of report" I meant, literally, the end of the reports section and not the end of the flow. Sorry if that was too vague.

[noamoss]

(just updated no. 6 above)

[akariv]

right, but now I see that, and notice the gender effect. למה ישיב זה בעיה וישתתף זה סבבה?

still should enable the "אולי בפעם אחרת" options This is exactly the 'לא תודה, סיימתי' option.

אפשר להמשיך אפשר להמשיך לאן? התוכן צריך לענות באיזשהו אופן על השאלה

reporters starting at 23:55 and getting to this question on 00:02?

reporters ending their last report before 23:59:59 and getting to that question after 00:00. As I said, an edge case

if there are not active reporters on the device for the last day

You can't get to that question without having at least one report. not worth handling imo

not exactly, I might want to stay in the bot in the name choosing step

That is true for all questions in the bot. Since you just said you'd like to answer these questions, so no point in providing an 'umm, I changed my mind' option

I think it is a mistake

So the option would say "סיימתי להיום, אינני מעוניין לענות על שאלות נוספות" and then we would ask a few more questions?

[noamoss]

1. right. update:

" מי ישיב על השאלון?" --> "עבור מי הדיווח"?

still should enable the "אולי בפעם אחרת" options This is exactly the 'לא תודה, סיימתי' option.

how come - these are two different steps - here I got stuck:

אפשר להמשיך אפשר להמשיך לאן? התוכן צריך לענות באיזשהו אופן על השאלה

makes sense, what about fitting the intro question to:

"ועכשיו - דיווח נוסף, או שנמשיך לשאלות אחרונות?"

reporters ending their last report before 23:59:59 and getting to that question after 00:00. As I said, an edge case

• preventing future QA... I assume it is not a quick fix? If so, let's leave as is - and agree in advance that if we will get this question more than 3 times (from QA people or real users) we will handle it.

That is true for all questions in the bot. Since you just said you'd like to answer these questions, so no point in providing an 'umm, I changed my mind' option

I disagree, actually it is not the same IMO - no other question throws the user/reporter out of the site and out of the current tab. This is what I want to prevent/ensure before the click.

So the option would say "סיימתי להיום, אינני מעוניין לענות על שאלות נוספות" and then we would ask a few more questions?

ok, let's keep it strict - what bout : "סיימתי להיום" vs. "אני מעונין גם לענות על שאלות לגבי תחושת לחץ ומצב רוח"

[akariv]

עבור מי הדיווח

👍

how come - these are two different steps - here I got stuck:

You said 'כן בשמחה' a second ago - why are you stuck?

"ועכשיו - דיווח נוסף, או שנמשיך לשאלות אחרונות?"

The current wording 'עבור מי ברצונך לדווח עכשיו?' fits the first interaction and subsequent interactions, your proposal doesn't :)

"more than 3 times"

👍

I want to prevent/ensure before the click

You know what, let's consult with the WIS team if they want to add a mechanism allowing the users to skip the questionnaire after they explicitly said 'yes' to answering it. 😉

סיימתי להיום

still, you say סיימתי להיום and then you keep asking more questions...

[noamoss]

You said 'כן בשמחה' a second ago - why are you stuck?

because I changed my mind. can't you imagine a scenario of regret? (I would honestly like the user to reconsider before flying out of the chatbot). Also - showing a single option in a question is very confusing. It would be much easier to show this functionality, than auto submitting the single uid to the external research, right?

...let's consult with the WIS team if they want to add a mechanism allowing the users to skip the questionnaire after they explicitly said 'yes' to answer it. wink

surprisingly, it was their offer... can't promise it will not change their mind :)

סיימתי להיום

still, you say סיימתי להיום and then you keep asking more questions...

--> "אולי בפעם הבאה" vs. "אני מעונין גם לענות על שאלות לגבי תחושת לחץ ומצב רוח"

[noamoss]

The current wording 'עבור מי ברצונך לדווח עכשיו?' fits the first interaction and subsequent interactions, your proposal doesn't :)

correct. let's leave the current wording. The last option to "דיווחתי עבור כולם, עוד משהו?"

[akariv]

Also - showing a single option in a question is very confusing

We could open the questionnaire immediately in that case.

אולי בפעם הבאה

ok

דיווחתי עבור כולם, עוד משהו

we're back to square one where people who didn't report for "everybody" get stuck - https://github.com/hasadna/avid-covider/issues/337#issuecomment-634846913

[noamoss]

let's go back to square one:

עבור מי תרצו לדווח?

• option a
• option b
• דיווחנו עבור כל בני הבית
• דיווחנו עבור כולם, אשמח להשיב גם לשאלון מחקר נוסף בנושאי לחץ ומצב רוח

[noamoss]

update last comment

[akariv]

That's even more problematic as a) it still mentions everybody and b) it encourages people to leave the loop

what's so bad with זהו להיום?

[noamoss]

what's so bad with זהו להיום?

the feedback they got (a signle feedback, AFAIK) that people thought's it is the end of the flow, and did not bother to click. There is something correct in this feedback.

but let's leave as is - if we both can't come with a better idea, this will remain for now - maybe something will come up on the QA, or later.

[noamoss]

you know what- I think that chaging "זהו להיום" to "זהו" might do the job. WDYT?

[noamoss]

@akariv

Summarizing (with a minor update) this long QA discussion, hope it will make things clearer:

1. we are not touching the main report loop, except for changing the label זהו להיום --> זהו.

2. the next question should be the external research question:

ועכשיו...רוצה לענות גם על מספר שאלות לגבי תחושת לחץ ומצב רוח?

א. כן, רוצה -->3 ב. בפעם אחרת -->4

3. external reporter chooser

   • ( " מי ישיב על השאלון?" --> "עבור מי הדיווח"?)
   • add a static option: בעצם, לא היום

4. reminder, sharing questions

[akariv]

I think you're mistaken

The option זהו להיום has been live about a week and a half.

Prior to that we had כל בני ביתי כבר דיווחו And before that סיימתי לדווח

The feedback you got was about one of these two options, not about זהו להיום.

Okay for the other stuff

On Thu, May 28, 2020 at 12:01 AM noamoss notifications@github.com wrote:

@akariv https://github.com/akariv

Summarizing (with a minor update) this long QA discussion, hope it will make things clearer:

1.

we are not touching the main report loop, except for changing the label זהו להיום --> זהו. 2.

the next question should be the external research question:

ועכשיו...רוצה לענות גם על מספר שאלות לגבי תחושת לחץ ומצב רוח?

א. כן, רוצה -->3 ב. בפעם אחרת -->4

1.

external reporter chooser

• ( " מי ישיב על השאלון?" --> "עבור מי הדיווח"?)

  • add a static option: בעצם, לא היום 2.

  reminder, sharing questions

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/hasadna/avid-covider/issues/337#issuecomment-634937153, or unsubscribe https://github.com/notifications/unsubscribe-auth/AACAY5IESGRTZEZM3O25Z53RTV5SPANCNFSM4NJAA7PQ .

[noamoss]

You are right, of course, lost my focus. We are ready to go.

On Thu, May 28, 2020, 9:21 AM Adam Kariv notifications@github.com wrote:

I think you're mistaken

The option זהו להיום has been live about a week and a half.

Prior to that we had כל בני ביתי כבר דיווחו And before that סיימתי לדווח

The feedback you got was about one of these two options, not about זהו להיום.

Okay for the other stuff

On Thu, May 28, 2020 at 12:01 AM noamoss notifications@github.com wrote:

@akariv https://github.com/akariv

Summarizing (with a minor update) this long QA discussion, hope it will make things clearer:

1.

we are not touching the main report loop, except for changing the label זהו להיום --> זהו. 2.

the next question should be the external research question:

ועכשיו...רוצה לענות גם על מספר שאלות לגבי תחושת לחץ ומצב רוח?

א. כן, רוצה -->3 ב. בפעם אחרת -->4

1.

external reporter chooser

• ( " מי ישיב על השאלון?" --> "עבור מי הדיווח"?)
• add a static option: בעצם, לא היום 2.

reminder, sharing questions

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub < https://github.com/hasadna/avid-covider/issues/337#issuecomment-634937153>,

or unsubscribe < https://github.com/notifications/unsubscribe-auth/AACAY5IESGRTZEZM3O25Z53RTV5SPANCNFSM4NJAA7PQ>

.

— You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub https://github.com/hasadna/avid-covider/issues/337#issuecomment-635131575, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA3KOLLEBWDJT2CWOTPGVCTRTX7H7ANCNFSM4NJAA7PQ .

[noamoss]

@akariv

1. "רוצה לענות גם על מספר שאלות לגבי תחושת לחץ ומצב רוח?" --> "ועכשיו, רוצה לענות גם על מספר שאלות לגבי תחושת לחץ ומצב רוח?"

2. "כן, בשמחה" --> "כן, רוצה"

(I don't think happiness fits here)

3. when I click on "בעצם לא היום", the research link is being opened (with an no-uid value.

[noamoss]

checked and approved.