Great catch @branscombj with regard to the blue bar titles! @AnnHier Session 1, Session 2, Session 3, Session 11 and Session 12 all have Psychotherapy appearing in the blue bar at the bottom of the screen from about 07 to 12 seconds into each of these videos. @branscombj notes no blue bar should appear but if the blue bars are going to be appear for consistency, I believe they should have the title of the session.

@lzim @dlkibbe @TomRust @dlounsbu @AnnHier My vote is no on blue bars for the 1-4, 11-12 videos because they have the title slide up front. I would actually prefer for the sessions 5-10 title slides to indicate which module they are and not use the blue bar after the presenters start - but I can live with the blue bar solution.

AnnHier commented 5 years ago

Great catch @branscombj with regard to the blue bar titles! @AnnHier Session 1, Session 2, Session 3, Session 11 and Session 12 all have Psychotherapy appearing in the blue bar at the bottom of the screen from about 07 to 12 seconds into each of these videos. @branscombj notes no blue bar should appear but if the blue bars are going to be appear for consistency, I believe they should have the title of the session.

@lzim @dlkibbe @TomRust @dlounsbu @AnnHier My vote is no on blue bars for the 1-4, 11-12 videos because they have the title slide up front. I would actually prefer for the sessions 5-10 title slides to indicate which module they are and not use the blue bar after the presenters start - but I can live with the blue bar solution.

Thanks, @branscombj - @lzim, since you have the title slides, I'll let you decide - is there a way for you to add the topics of each module to the slide themselves so modules 5-10 don't have to use the blue bar solution?

Thanks!

TomRust commented 5 years ago

@branscombj -- I'll email you the "Pause for..." times table for all the Session 9 videos today.

branscombj commented 5 years ago

@branscombj -- I'll email you the "Pause for..." times table for all the Session 9 videos today.

@TomRust OK - or paste it here, thanks!

TomRust commented 5 years ago

@branscombj

Session 9	Action	Time Stamp
Care Coordination (CC)	Pause and open the session guide at mtl.how	0:46
CC	Pause and log in at mtl.how/sim	2:21
CC	Pause and type your Question and Hypothesis in the text boxes	24:51
CC	Pause, study the results and type your Findings	29:35

Psychotherapy (PSY aka “Cut1”)	Pause and open the session guide at mtl.how	0:28
PSY	Pause and log in at mtl.how/sim	1:39
PSY	Pause and review the distribution of your own patients’ engagement patterns	12:00
PSY	Pause and type your Question in the text box	14:12
PSY	Pause and type your Hypothesis in the text box	16:41
PSY	Pop-up: “Make sure to double check your sliders before you click Run!”	17:43
PSY	Pop-up: “Actually, more than 4.15 patients are ending psychotherapy each week…Can you find the other ending rates in the Model Diagram?	19:21
PSY	Pause, study the results and type your Findings	24:52

Medication Management (MM)	Pause and open the session guide at mtl.how	0:20
MM	Pause and log in at mtl.how/sim	2:17
MM	Pause and type your Question in the text box	16:24
MM	Pop-up: “He means the top of the data table.”	19:25
MM	Pause and type your Hypothesis in the text box	33:13
MM	Pause, study the results and type your Findings	39:43

Suicide Prevention (SP)	Pause and open the session guide at mtl.how	0:26
SP	Pause and log in at mtl.how/sim	1:40
SP	Pause and type your Question in the text box	15:35
SP	Pause and type your Hypothesis in the text box	19:41
SP	Pause, study the results and type your Findings	27:40

Aggregate (AGG)	Pause and open the session guide at mtl.how	0:49
AGG	Pause and log in at mtl.how/sim	4:17
AGG	Pause and type your Question in the text box	9:12
AGG	Pause and type your Hypothesis in the text box	27:50
AGG	Pause, study the results and type your Findings	36:21

lzim commented 5 years ago

Great catch @branscombj with regard to the blue bar titles! @AnnHier Session 1, Session 2, Session 3, Session 11 and Session 12 all have Psychotherapy appearing in the blue bar at the bottom of the screen from about 07 to 12 seconds into each of these videos. @branscombj notes no blue bar should appear but if the blue bars are going to be appear for consistency, I believe they should have the title of the session. @lzim for sessions 2 and 3 titles, do you want a hyphen in "user-interface" as it currently appears or "user interface" with no hyphen.

@dlkibbe no hyphen, I introduced this error (I think) somewhere along the way, but I looked into standard style and "user interface" no hyphen is used. We changed it on the title slides here: https://github.com/lzim/teampsd/tree/master/resources/title_slides

Thanks!

TomRust commented 5 years ago

@branscombj & @lzim -- I've got two suggestions for popups for MM Session 8:

28:50 -- If your dynamic hypothesis includes any ideas about the new patient start rates changing, then you need to turn the team data for new patient start rates "off," so that they won't be held at the historic median values, but will instead be allowed to respond to the changes you've made to the experiment sliders." 34:01 -- In this experiment, because the team data on new patient start rates was left "on," all changes to those rates are from the model starting to set start rates based on those data in Week 0, in place of start rates based on slot availability (i.e., the team only starts a new patient after all existing patients are seen each week). If you don't believe me, then compare these start rates to the results from the base case (session 7).

branscombj commented 5 years ago

@AnnHier @dlkibbe @lzim @TomRust @dlounsbu I'm replacing the table I had posted with just the 3 EDIT rows for Ann. I will re-post the pop-ups table when it's completed.

05 PSY	EDIT		Video doesn’t show LZ logging into mtl.how/sim (Sim UI)	3:40
08 PSY	EDIT		ADD Screen Shot LZ reviewing file name	28:13 (15 seconds)
08 AGG	EDIT		Show LZ typing in Hypothesis box so viewer can see the text and do the action below	16:15-16:26

branscombj commented 5 years ago

Session 4: Does it make sense to suggest viewers pause and complete the mtl menu (e.g. at 3:43) if they haven't? (If the viewer is part of a team, will submitting the form return their personalized team summary results as shown in the video? ... Or, at the end after mentioning the tt report that goes out after session 4, could have a pop-up saying to open and review the team's menu results in that if they have it.

@staceypark @lzim Can you tell me how the mtl menu works - if someone's watching the video of session 4 and they missed their team meeting, if they just go to mtl.how/menu, it won't "know" what team they're on, so the survey app won't combine their responses with their team's and show that for them, will it? What do you recommend as I'm thinking through popups for session 4? Thanks!

branscombj commented 5 years ago

Finally, the graphic explaining the "Do/Done."

My suggestions on this one (@lzim @dlkibbe @staceypark please yay, nay, or revise these points): a) Make the text generic: The PSY module is shown, but this session's Done/Do Review is the same for all modules. b) Don't use a person's picture - instead make it like the blue bar that appears at the beginning of each 5=10 session to identify the module. c) Put it in all sessions 5-10 EXCEPT the PSY ones. d) Put it at the same point in all of them, right at the beginning as the Lindsey's introducing her co-presenter.

branscombj commented 5 years ago

My proposals/questions re: icons in popups ( @lzim @dlkibbe @staceypark @TomRust please weigh in, especially on ?s):

For Pauses use the double-bar symbol as discussed. Include the word "pause"? In all caps? With imperative on next line? Without connector (pause AND or pause TO)?
For Corrections what symbol? None, only person's face? Use the word "oops"? Include "!"?
For Info/Tips use the circle-i icon? Put it where the "face" would be and not include a photo?
For Updates, I say treat them like Corrections. Use image of LZ since now co-presenters are in so many pop-ups? Replace "Oops!" with "Update!" Next line: "You may see something different due to improvements." Or some language like that which is not specific to the change.
I do not think we should have any other types of pop-ups.

branscombj commented 5 years ago

@lzim @dlkibbe @TomRust @dlounsbu @staceypark Current popups spreadsheet: Pop-ups (3).xlsx Caution: some time stamps in MM:SS format converted to decimals or 12-hour clock times in separate worksheets. They're correct on the ALL worksheet. Larger ones look like HH:MM:SS but are really MM:SS:00.) Working on consistency, brevity of text, completeness. Missing sessions: 1 - 2 - 3 - 4 - 7MM,PSY,AGG,SP - Jane 10 - Debbie 12 -

TomRust commented 5 years ago

Hi @branscombj ,

Not all the times for session 9 copied into the spreadsheet correctly (I found two mistakes in CC, which only has (for now) four pauses -- a 50% error rate is no good!). I was going to start re-watching the session 9 videos today, to add more pauses, corrections, and info/tips. Do you have standard language for the pauses and info/tips? If we have "perfect" language, I'd rather use that the first time, than have to go back in again to make final tweaks. Thanks!

--TOM

branscombj commented 5 years ago

@TomRust

Not all the times for session 9 copied into the spreadsheet correctly (I found two mistakes in CC, which only has (for now) four pauses -- a 50% error rate is no good!).

YIKES!! You're right - that is NO Good! Maybe we should use something other than Excel, which outsmarts itself interpreting 00:00 formatted numbers.

Do you have standard language for the pauses and info/tips? If we have "perfect" language, I'd rather use that the first time, than have to go back in again to make final tweaks.

I suggest you look at the worksheet for session 5 in the Excel file - esp the first 10 rows, which I've uniformized - and do something like that, with the modules side by side for each session. This way you can be internally consistent across all the modules for that session and once you settle on brief language you can paste it where it occurs in others. They won't all have exactly the same popups, and definitely not all in the same sequence - but many will be the same. You need 3 columns for video: type of popup (Correction, Pause, or Info/Tip); Wording (not including "Pause" etc.); Time stamp. Debbie even put duration for her Info/Tip ones; but maybe those could be standard - 4 seconds or so? Also Lindsey would like us to use icons in the popups where we have standard ones (Running Person, for ex). So maybe a 4th column - or link to the icon on Github right in the popup text.

Style rules I started using:

For actions that are labeled in the UIs, use extra verbs sparingly and quotation marks not at all; just capitalize the commands: Enter Hypothesis and Save your work. Not: Click in the "Hypothesis" box to enter your text. Click "Save" to save your work.
Fine to use = sign for definitions: Control C = Copy

lzim commented 5 years ago

Hurray - it's FRIDAY :balloon:

In the spirit of avoiding rework FYI @branscombj @dlkibbe @TomRust @dlounsbu and @staceypark and @jamesmrollins

This MTL Video review for pop-up information needs to be done with mtl.how/sim TEST (i.e., https://forio.com/app/va/va-psd-test.html)

Everyone needs to become as familiar as @TomRust is with the TEST changes :sweat_smile:

NOTE that we need all timestamps in the videos for the "upgrades" or "new features" that require pop-ups and the easiest way to catch that is with the relevant TEST module open and walking through the runs described in the video - it's a two-fer the MTL 1.8 Release Sprint and the MTL Video Review done at the same time.
AND keep in mind that everything that is in TEST now needs to be updated in all the MTL 1.8 session guides (.gifs and language), cheatsheets and emails... BEFORE WE CAN TRAIN THE OMHSP TAS in that session

You'll see that @jamesmrollins has our checklist regarding updating the documentation in all the relevant module issues: MTL 1.7 to 1.8 Sprint - https://github.com/lzim/teampsd/issues/298

CC - https://github.com/lzim/teampsd/issues/306 MM - https://github.com/lzim/teampsd/issues/309 AGG - https://github.com/lzim/teampsd/issues/314 PSY - https://github.com/lzim/teampsd/issues/319 SP - https://github.com/lzim/teampsd/issues/320

Okay, I will try to catch up on the standardization discuss above ASAP - but wanted to highlight the interdependence of the

MTL Vide pop-ups
Concurrent Testing in TEST
MTL 1.8 documentation updates - These can also be nested :bird: in the same "review" next by a) creating pull-requests for session guide edits as you work through the videos, and/or b) adding a list of running documentation changes you'll need to make to the relevant module issues above

Thanks y'all :100:

staceypark commented 5 years ago

@lzim @dlkibbe @TomRust @branscombj @dlounsbu Spreadsheet for pop-up edits here: https://osf.io/2rfnd/

branscombj commented 5 years ago

My proposals/questions re: icons in popups ( @lzim @dlkibbe @staceypark @TomRust please weigh in, especially on ?s):

For Pauses use the double-bar symbol as discussed. Include the word "pause"? In all caps? With imperative on next line? Without connector (pause AND or pause TO)?

For Corrections what symbol? None, only person's face? Use the word "oops"? Include "!"?

For Info/Tips use the circle-i icon? Put it where the "face" would be and not include a photo?

For Updates, I say treat them like Corrections. Use image of LZ since now co-presenters are in so many pop-ups? Replace "Oops!" with "Update!" Next line: "You may see something different due to improvements." Or some language like that which is not specific to the change.

I do not think we should have any other types of pop-ups.

@lzim @staceypark @dlkibbe I don't know if these details are resolved. Thoughts? We will need to give @AnnHier specific guidance (or ask for her expert opinion).

branscombj commented 5 years ago

@staceypark @lzim @TomRust @dlkibbe I'm puzzled. Here's what worksheet for 08 looks like in OSF view mode:

Here's what it looks like when I download and open in Excel:

Here's 06 in osf:

And here's 06 in Excel in the downloaded file:

lzim commented 5 years ago

@branscombj @staceypark @TomRust @dlkibbe

Weird! 😕 I'll be working directly with Excel, not relying on OSF viewer, then.

Did everyone finish their coding in the OSF worksheet? I'll be reviewing and pining Ann. Thanks!

dlkibbe commented 5 years ago

@branscombj @lzim @staceypark @TomRust Session 6 times needed the apostrophe (') in front of the numbers - I've fixed that session. Session 10 and Session 12 are included in the file I uploaded this evening. I noted our language across all tabs for a similar action is not uniform: Edit Hypothesis text vs. complete edits to the Hypothesis text (just an example).

staceypark commented 5 years ago

@AnnHier I think in Session 4 time 18:44-190:50 needs to be cut? You and @lzim talk about the screencast before diving back into the script

AnnHier commented 5 years ago

@AnnHier I think in Session 4 time 18:44-190:50 needs to be cut? You and @lzim talk about the screencast before diving back into the script

Thanks, @staceypark! Please include it in the master list of edits and additions. @lzim , I'm in the middle of a shoot still tomorrow and will be unavailable for the call. I believe the team is almost done with the worksheet, correct! Thanks, team!

branscombj commented 5 years ago

@AnnHier (cc: @lzim @staceypark @dlkibbe @dlounsbu @TomRust ) Attached is the latest version (11) of the pop-ups spreadsheet from where we've been working on it in OSF. It covers all but sessions: 2, 3, 7AGG, and 7SP. Please take a look and let us know if you have concerns or feedback before you get your team to work on these, and if you want to get started or wait until we finish the last 4 over the next few days. Thanks! mtl_video_review_popups.xlsx

AnnHier commented 5 years ago

@AnnHier (cc: @lzim @staceypark @dlkibbe @dlounsbu @TomRust ) Attached is the latest version (11) of the pop-ups spreadsheet from where we've been working on it in OSF. It covers all but sessions: 2, 3, 7AGG, and 7SP. Please take a look and let us know if you have concerns or feedback before you get your team to work on these, and if you want to get started or wait until we finish the last 4 over the next few days. Thanks! mtl_video_review_popups.xlsx

@branscombj, you rock! The only thing I think would be great to add to it are the cuts mentioned in the thread - so not the popups per se, but the edits to the videos as well. I've been trying to keep a tally on those too, but I want to make sure I'm not missing anything! Thanks again!

branscombj commented 5 years ago

@branscombj, you rock! The only thing I think would be great to add to it are the cuts mentioned in the thread - so not the popups per se, but the edits to the videos as well. I've been trying to keep a tally on those too, but I want to make sure I'm not missing anything! Thanks again!

@AnnHier The only one I've seen mentioned is the one above for Session 4. Are there others? I have not been making recommendations for edits in the sessions I've reviewed, and haven't heard of any from @TomRust or @dlkibbe either.

AnnHier commented 5 years ago

@branscombj good question, I'm looking through the thread and my notes from calls now. :)

lzim commented 5 years ago

Thanks @annhier and @branscombj

I got notes from Andrew on sessions 2 & 3 on Friday and should have those to Ann today.

Thanks!

branscombj commented 5 years ago

Hey @AnnHier - The links for session 2 and 3 at the top are the same (both session 2). Could you add the session 3 link up there? I think @lzim was going to review 2 & 3 for corrections/popups and hasn't gotten to them yet. (The missing session 7 popups are on me:) Thanks! I was clicking through them to see all the total times. I think the longest of all is 07MM, but I didn't see any part I could easily recommend cutting out.

branscombj commented 5 years ago

Video durations, just so we know. Three are >40 minutes.

Session	Length
1	13.31
2	29.04
3
4	21.48
5CC	28.19
5MM	30.03
5PSY	31.12
5AGG	26.31
5SP	29.58
6C	25.22
6M	31.54
6P	31.41
6A	32.15
6S	34.11
7C	32.42
7M	34.46
7P	29.06
7A	31.13
7S	30.06
8C	34.02
8M	40.23
8P	31.11
8A	32.11
8S	38.28
9C	35.12
9M	42.52
9P	29.09
9A	38.53
9S	32.55
10C	32.24
10M	38.29
10P	28.47
10A	40.53
10S	34.05
11	12.03
12	23.33

lzim commented 5 years ago

Thanks @branscombj

@staceypark Can you please send a table to Dr. James Pittman that shows the videos that need to be piloted by social work? We told him on Wednesday we would get that to him 😄

AnnHier commented 5 years ago

@lzim, I'm working on getting the correct link now! Sorry about that.

AnnHier commented 5 years ago

Hello, here is the correct link for session 3: https://bcove.video/2A5xGoP

Thanks for your patience!

lzim commented 5 years ago

Got it! Thanks @AnnHier 😸 We'll get these last pieces to you ASAP.

lzim commented 5 years ago

Thanks @branscombj

Video durations, just so we know. Three are >40 minutes.

Session Length 1 13.31 2 29.04 3 30.54 4 21.48 5CC 28.19 5MM 30.03 5PSY 31.12 5AGG 26.31 5SP 29.58 6C 25.22 6M 31.54 6P 31.41 6A 32.15 6S 34.11 7C 32.42 7M 34.46 7P 29.06 7A 31.13 7S 30.06 8C 34.02 8M 40.23 8P 31.11 8A 32.11 8S 38.28 9C 35.12 9M 42.52 9P 29.09 9A 38.53 9S 32.55 10C 32.24 10M 38.29 10P 28.47 10A 40.53 10S 34.05 11 12.03 12 23.33

It is helpful to think about this, looks like: 3 videos > 40 minutes 4 videos > 35 minutes < 40 minutes 17 videos > 30 minutes < 35 minutes 8 videos > 25 minutes < 30 minutes 2 videos > 20 minutes < 25 minutes 2 < 20 minutes

holbrooa commented 5 years ago

I just watched session 3, and I thought it was really solid. We could maybe have a pop up or two where the layout of the table on screen is slightly different now, like for SPParams, but I don't think that's worth it. After all, nothing about using the spreadsheet changes, and everything said in the video is still correct - e.g. "look at these labels" and "this column has descriptions of the variables" etc. In the video, nothing is referred to by its row, but rather by its label. The labels will move with the values, so a popup correction seems totally unnecessary.

The only other thing I could think of would be popups explaining interesting values shown on screen e.g. "this zero indicates that the team we're looking at doesn't see patients for depression, according to the data" but the video didn't go in that direction at all, so that popup would probably be more distracting than helpful. I mean, no matter when you put that popup on screen, you put the viewer in the annoying situation of a text popup that isn't talking about the same thing as the presenter at that moment.

lzim commented 5 years ago

Okay, great! Thanks @holbrooa for reviewing this session too as the data UI tools are your “baby.”

I’ll combine with the S2 notes in the table and make sure @annhier has everything she needs.

One question I had was whether we should introduce you with a pop-up anywhere so folks can put your name/face together. we’ll have the team site to introduce you, if it doesn’t go in the video. But, I’ll keep an eye out, since “Andrew the data guy,” does often implement fixes based on field ideas, etc.

branscombj commented 5 years ago

Okay, great! Thanks @holbrooa for reviewing this session too as the data UI tools are your “baby.”

I’ll combine with the S2 notes in the table and make sure @AnnHier has everything she needs.

One question I had was whether we should introduce you with a pop-up anywhere so folks can put your name/face together. we’ll have the team site to introduce you, if it doesn’t go in the video. But, I’ll keep an eye out, since “Andrew the data guy,” does often implement fixes based on field ideas, etc.

I added a time stamp in sessions 02 and 03 where we first get into the data UI onscreen where I think we could add Andrew's ID in a pop-up. What should it look like? Maybe like the credentials for other presenters except include his picture and somewhere say something like "Data UI brought to you by"? @lzim @holbrooa

lzim commented 5 years ago

Thanks for adding that to the table @branscombj 👏

Yes, "Data UI brought to you by" is good.

Do you have a preference @holbrooa ??

AnnHier commented 5 years ago

Just checking in, team! Are the notes pretty much solidified for changes? Thanks!

branscombj commented 5 years ago

@AnnHier @staceypark @lzim @dlkibbe @TomRust Here is the finished pop-ups list. Please let us know if you have any questions! THANK YOU!! mtl_video_review_popups.xlsx

AnnHier commented 5 years ago

Thank you @branscombj and team! Have a great Easter/Passover weekend!

lzim commented 5 years ago

Thanks so much for everyone's hard work all along the way! @AnnHier @staceypark @lzim @dlkibbe @TomRust @branscombj

Yes, have a great Easter/Passover weekend too, Ann!

AnnHier commented 5 years ago

Hi team, just checking - where is the link for all the headshots, plus Andrew's credentials? Thanks! Happy Friday!

staceypark commented 5 years ago

@AnnHier happy friday! You can get to everyone's headshots here in our folder of TeamPSD headshots: https://github.com/lzim/teampsd/tree/master/resources/headshots

@holbrooa credentials: He has a BS in Industrial Engineering - is that what you're looking for?

AnnHier commented 5 years ago

@AnnHier happy friday! You can get to everyone's headshots here in our folder of TeamPSD headshots: https://github.com/lzim/teampsd/tree/master/resources/headshots

@holbrooa credentials: He has a BS in Industrial Engineering - is that what you're looking for?

Thank you! That's perfect. I couldn't seem to find @TomRust in the headshots, but it's Monday and I haven't had my coffee yet.

One last question, I noticed that some popups are "credited" to a contributor, and others are not - depending on video - for example, videos 5 and 9 do not have any presenter to go along with the popup. I probably missed it in the discussion, but just confirm for me that it's meant to be that way. Thanks!

lzim commented 5 years ago

@TomRust Can you please upload your headshot 😄

Hmm...Let me look at the table for videos 5 and 9 regarding the pop-up attribution. Unless @branscombj or @dlkibbe know more about it off the top of their heads.

Thanks!

AnnHier commented 5 years ago

Thanks, @lzim, in the meantime, we're beginning work on the tabs of the spreadsheet creating the graphics.

staceypark commented 5 years ago

@AnnHier sorry my bad! @TomRust headshot should be at the link too now

AnnHier commented 5 years ago

@AnnHier sorry my bad! @TomRust headshot should be at the link too now

Got it, @staceypark! Thanks!

AnnHier commented 5 years ago

mtl L3 example

Hi team, can you take a look at the screenshot and let us know if that placement looks okay? Also, please let me know about the "crediting" folks, and if you'd like to add the words "Correction," "Tip," "Info/Tip," and "whoops" to the graphics! :) Thanks.

lzim / teampsd

MTL.how video links! #294

For the latest MTL Video links, please:

1) go to https://mtl.how/documents

2) find the depend_products column on the far right

3) click on the relevant session & the video link will be at the top