Hello team, and happy new year. Thanks for all the work you've been putting in carefully reviewing our work! We're re-doing session two right now. Here is a second (smaller) batch.

mtl Session 9 Aggregate Module Cut1: https://bcove.video/2GriKXD

mtl Session 9 Suicide Prevention Module Cut1: https://bcove.video/2A6BQwz

mtl Session 9 Med Management Module Cut1: https://bcove.video/2GsyKJ4

mtl Session 9 Cut1: https://bcove.video/2A7E9zx

mtl Session 9 Care Coordination Module Cut1: https://bcove.video/2A0X2Eg

AnnHier commented 5 years ago

And here is the (nearly) final batch.

The only video we’re missing is for Session 4 right now which will need to be exported from the editing computer (Avid) again - just a technical snafu.

mtl Session 10 Suicide Prevention Module Cut 1: https://bcove.video/2SaRRIP

mtl Session 10 Med Management Module Cut1: https://bcove.video/2R9NC3i

mtl Session 10 Aggregate Module Cut1: https://bcove.video/2S8LAgZ

mtl Session 10 Care Coordination Module Cut1: https://bcove.video/2R6u7Zd

mtl Session 10 Cut1: https://bcove.video/2Gtdtiu

mtl Session 11 Cut1: https://bcove.video/2GpFqaD

mtl Session 12 Cut1: https://bcove.video/2GsZWr6

lzim commented 5 years ago

Thanks @annhier!

lzim commented 5 years ago

Hi Team PSD Co-Facilitators!

As we discussed on the MTL Launch call yesterday, please...

Start reviewing the videos of sessions you are in 🎥
Record any confusing statements that may need a pop-up message to the learner by tracking the following here in Issue #294.
- Timecode
- Who will be the "face" of the catch? - photo
- Really brief explanation - for clarity (1 sentence)

Thanks, have a great Dr. MLK Jr. holiday weekend everyone! ☮️ 🍑 (peach for Georgia)

Lindsey

branscombj commented 5 years ago

Thanks for the 🍑! 😄 I'll add ⚖️ and, for MLK Day inspiration, offer the story of our dear friend Nan Pendergrast, whose amazing 98-year life we will celebrate tomorrow. She told me a few months ago that having a grandmother who was born as Atlanta burned and Sherman’s troops occupied the upstairs gave her the cred she needed in conservative white circles she pushed on throughout her decades of just work.

AnnHier commented 5 years ago

Hi all! Here is that elusive MTL Live Session 4: mtl Session 4 Cut1: https://bcove.video/2RRnryy

Thanks - sorry for the delay - editing computers were being updated.

staceypark commented 5 years ago

@AnnHier Is there a timeline for when the Session 2 and Session 4 video links will be posted?

@branscombj @dlkibbe Thanks for the lovely headshots! I moved them here: https://github.com/lzim/teampsd/tree/master/resources/photos

@dlounsbu @TomRust please add your headshots to the above link as well!

AnnHier commented 5 years ago

Hi Stacey,

Here is session 2 - sorry about overlooking that one, and session 4 is above in the thread, posted on 1/24 - let me know if you have any trouble accessing them, and thanks for the headshots so far!

@AnnHier I'm taking out the old link for Session 2, since we now have the proper cut.

AnnHier commented 5 years ago

Just an FYI about session 2 - I don't believe we've re-uploaded that one after edits, I looked back in the history and that one was posted then removed because we still needed to block out a patient name; please know these links cannot be found by being searched, you need the full link (only posted here) to go to it. In the meantime, we'll get started on that change. Thanks!

branscombj commented 5 years ago

Session 6 - AGG Questions/observations:

Speakers' names/titles - What is the rule/standard for when they appear. In this session, they seem to come up quite late. Would it make sense to just have them on the opening title slide? What about the Done/Do co-presenter? a. Here, LZ’s shows up at 3:22. b. I don’t know if JB’s is shown – I didn’t see it but I might’ve missed it. c. In the Done-Do review, which starts at 25:25, LZ is re-identified at 27:40; DL at 29:37.
At 16:47 LZ clicks on an “i” and we see “Need i information” in the box that comes up, briefly.
Is there something we are going to do outside of the recording itself to alert folks that the Done/Do Reviews for sessions 5-10 are all recorded in PSY regardless of the module of the main session? In this occurrence, it seems kind of awkward as you view it straight through, because LZ is suddenly talking about PSY in the Done/Do without any warning or acknowledgement.
Why is there an arrow directly from Patients Waiting to Start Service stock to Delay to Starting Service? (see below)
RVI Delays Affects Treatment Decisions doesn’t look like a complete loop. (see below)

AnnHier commented 5 years ago

HI Jane, good questions! I waited until there was a spot when I could take a single shot of the speaker before I could put their name up and keep it up for a decently long period of time - because there was a lot of back and forth, generally. It's fairly typical - unless it's a 24 hour news show and super heavy on graphics - to see the speaker's name throughout a presentation like this. We tended to treat the do-done reviews as separately shot sessions that people would be watching later, so we re-show the graphics for Lindsey (and show them for a new presenter). I wanted to make sure each person's information came up at least once during their appearance in each separate video. Let me know if that makes sense, or if we'd like to take a different approach - I just didn't want to distract from the content while gently letting viewers know a bit more about the speaker's backgrounds once we're into the content as well.

Jane Here - Thanks, @AnnHier ! That makes sense. If you have an easy way to scan through this session and see if my ID is included that would be great. If not I'll re-watch; just thought you might have frame-by-frame viewing. As for Done-Do Review, I think we expect people to watch straight through - it's really part of the session. Since it's so short and since LZ always says the name of the TeamPSD member presenting it with her at the start of it, I myself don't think text IDs are needed for those segments and may be more distracting than helpful. Anyone accessing the videos via TMS - which may be everyone - will have all of the presenters' names and bios provided there too, right?

AnnHier commented 5 years ago

Hi all, here is the sample "popup" graphic we made - we kept it very simple, and modeled it after a chat text message or similar. I kind of like its simplicity, but let me know what you think! Thanks! pop-up graphic

Jane here - I like it! Only question would be font and font size (could it be smaller?). We definitely have to make text for these, where used, extremely short, so viewers grasp it quickly without having to think.

AnnHier commented 5 years ago

@lzim, we have "cut 2" up for session 2 now, with the spot in question now edited out! Thanks! The link is the same: mtl Session 2 Cut2: https://bcove.video/2GoRKZ0

lzim commented 5 years ago

Hi all, here is the sample "popup" graphic we made - we kept it very simple, and modeled it after a chat text message or similar. I kind of like its simplicity, but let me know what you think! Thanks!

Jane here - I like it! Only question would be font and font size (could it be smaller?). We definitely have to make text for these, where used, extremely short, so viewers grasp it quickly without having to think.

@branscombj let's not edit each other's comments

branscombj commented 5 years ago

@AnnHier @lzim @dlkibbe @staceypark : See disposition comments added below.

Session 6 - AGG Questions/observations:

Speakers' names/titles - What is the rule/standard for when they appear. In this session, they seem to come up quite late. Would it make sense to just have them on the opening title slide? What about the Done/Do co-presenter? a. Here, LZ’s shows up at 3:22. b. I don’t know if JB’s is shown – I didn’t see it but I might’ve missed it. c. In the Done-Do review, which starts at 25:25, LZ is re-identified at 27:40; DL at 29:37.

Above are settled per Ann's response, except for b, which I will double-check on when I re-view the video for pause spots.

At 16:47 LZ clicks on an “i” and we see “Need i information” in the box that comes up, briefly.

I don't recommend doing anything about this in MTL Video. Just noting it. And will double-check that it's fixed in current version.

Is there something we are going to do outside of the recording itself to alert folks that the Done/Do Reviews for sessions 5-10 are all recorded in PSY regardless of the module of the main session? In this occurrence, it seems kind of awkward as you view it straight through, because LZ is suddenly talking about PSY in the Done/Do without any warning or acknowledgement.

Above is settled per 1/31/19 Lucid meeting notes. Exact text of pop-up to be finalized.

@TomRust Could you check the below out and clarify for me? Thanks!

Why is there an arrow directly from Patients Waiting to Start Service stock to Delay to Starting Service? (see below)

RVI Delays Affects Treatment Decisions doesn’t look like a complete loop. (see below)

AnnHier commented 5 years ago

Hello, team! Thanks for the productive call today. I have some samples for you. First, the pop-up graphic with smaller font: pop-up graphic-1 Then, the graphic for the "pause" (these all use Debbie, BTW). I used some sample language. pop-up graphic-2 Finally, the graphic explaining the "Do/Done." pop-up graphic-3

Let me know what questions or suggestions you have! Thanks!

dlkibbe commented 5 years ago

@AnnHier Session 5 MM Video - 2 things:

Should we assume that people know that Ctrl C = Copy and Ctrl V = Paste are known to users? If not, we could put a pop up box at 12:03 in the session 5 MM with this information.
At 13:05 LZ makes note of an "Explorer" file - it should be an "Excel" file. Perhaps we can put a note on the screen.

AnnHier commented 5 years ago

1) Hi @dlkibbe , great questions. :) We can make a popup box there for sure - but before we create any for any videos and edit them in, are we considering any of these changes final for the MTL group, or should we hold off until @lzim and the rest of the team greenlights them all from a "master list"? I know we were talking about doing them as we got them, but I almost think it would confuse my editors less if it's one big list and we can do it all in one fell swoop. Let me know! :+1: 2) Again, absolutely we can put a note in - I would also ask that any of these popups, etc - we be given the exact wording for. Thanks!

dlkibbe commented 5 years ago

@AnnHier I assume there will be a master list. I'm just trying to document as soon as I watch so I don't lose the information!

AnnHier commented 5 years ago

@dlkibbe you bet! Sounds like a plan.

branscombj commented 5 years ago

@lzim @dlkibbe @AnnHier Another dribble of video notes.

All session videos: Do we want to put a pop-up near the beginning telling viewers to pause and pull up the learner guide - for directness and emphasis? I lean no, but could be persuaded.

Session 4: Does it make sense to suggest viewers pause and complete the mtl menu (e.g. at 3:43) if they haven't? (If the viewer is part of a team, will submitting the form return their personalized team summary results as shown in the video? ... Or, at the end after mentioning the tt report that goes out after session 4, could have a pop-up saying to open and review the team's menu results in that if they have it.

Session 4: At 7:01, @lzim you go from describing the AGG module to describing SP without naming the SP module or making it clear you're talking about another one. A pop-up could say something like, "The Zooming Out module is SP." or "Oops! Now I'm talking about the SP module."

staceypark commented 5 years ago

@AnnHier As @lzim mentioned in the meeting, we want to

[ ] use all lowercase for "MTL" when referred to as a link (i.e. mtl.how/sim)
[ ] remove the exclamation point in the "Pause"

lzim commented 5 years ago

@AnnHier

Notes from today's MTL Launch meeting:

lowercase for the links e.g., mtl.how/sim
Pause pop-up looks good, but let's remove the ❗️

Ending slide, edited tagline: https://github.com/lzim/teampsd/blob/master/resources/logos/mtl_testdontguess_sm.png

branscombj commented 5 years ago

@AnnHier @lzim @staceypark @dlkibbe @TomRust @dlounsbu Just checking in on correct video links - are all the ones in the 12/19/18 post the latest? If so, maybe we could delete the 1/2/19 ones to remove confusion. Thanks!

branscombj commented 5 years ago

@AnnHier @lzim @staceypark @dlkibbe Session 6 SP looks good. Possible pop-ups:

LZ gives a good verbal cue at 3:10 for viewer to pause and log in to the sim UI; but a pop-up for consistency could be good here. Suggested text: "Pause and log in at mtl.how/sim to follow along"

Suggest popup at 10:58 to say "Pause and review "i" for diagram variables". [I will note time stamps for this same text - and that below - for all session Sixes, and suggest that you, @dlkibbe , note the same for team data table variables in the session Fives.]

Suggest popup at 11:58 to say "Pause and review "i" for experiment variables"

At 20:39, LZ is showing how you can click any of the gray variables with the "+" sign to zoom out. Just before, we covered the + and - of causal arrows. Suggest putting a LZ popup here saying "This + means you can zoom out to see more"

Suggest popup at 25:22 to say "Pause and check out more of the systems stories in the diagram"

branscombj commented 5 years ago

@lzim @staceypark @TomRust @dlkibbe @dlounsbu I recommend these standard pop-ups:

ALL sessions, just after LZ clicks to open the learner see guide (exact time stamp to be identified for each video by reviewers): "Pause and open the session guide at mtl.how"
Sessions 5-12, just as LZ clicks to log in to the ind world of the simUI (exact time tbd by reviewers): "Pause and log in at mtl.how/sim" [Definitely all sessions 5-10; but I think also for 11 & 12 if/when LZ logs in to them.]
Sessions 2-3, same as above, just as LZ clicks to log in to the dataUI, but text is "Pause and log in at mtl.how/data"
For Session 4, my questions above - should they log in at mtl.how/menu and complete it - and if they do, will it show them their and their team's aggregate results? - or should it say to open the summary in the tt report?
I suggest no popups during the done/do review. Except maybe the one saying it's the same regardless of module.
In addition to popups about opening the session guide and the UI, at least 1 and no more than 3 additional pauses to check out on their own something being shown on screen. This should be the same message or set of messages for all the different modules of a given session (for example, see the 3 recommended for sessions 6es with SP time stamps shown above) - and as similar across the 12-session plan as possible. Might be, for example, "Pause and type your Question in the text box" or "Pause, study the diagram and type your Hypothesis" or "Pause, study the results and type your Findings".

AnnHier commented 5 years ago

@branscombj, good catch! It was a double posting - these are actually the same exact links/same files. We can delete the second one if you like!

branscombj commented 5 years ago

@branscombj, good catch! It was a double posting - these are actually the same exact links/same files. We can delete the second one if you like!

Thanks, @AnnHier ! No worries as long as the links are the same.

dlounsbu commented 5 years ago

Hi @AnnHier ,

I have reviewed Sessions 1, 10 and 12. I did not see any real problems with these sessions. Overall, they work very well. I did not like that I was somewhat deadpan on Session 1. Session 10 is long, it works. Session 12 was great and covered so much useful information regarding resources.

staceypark commented 5 years ago

@dlounsbu @TomRust @dlkibbe @branscombj @lzim

@branscombj raised a great point that we missed at the Launch call this morning. We're looking to give @AnnHier pop-up information not just for edits on corrections/fixes, but also for places the learner should stop and pause to do something (experiment runs, check out resources, etc.):

When drafting these edits for Ann, folks should also keep in mind... 1) Adding a specific ask to these pop-ups 2) Adding related iconography to the ask (i.e. the green play man for asks related to running the sim experiments)

@AnnHier Just to double check on the Pause buttons... 1) Double check - Are these also including the facilitators' faces just like the other pop-ups? If they are not, we would like for them to have the little photos of facilitators in these pop-ups as well 2) Heads up - We are also looking to add a specific add and related iconography to the non-correction pop-ups as you can see above.

branscombj commented 5 years ago

@AnnHier Just wondering if these titles will remain, and if so, if we might be able to edit them? I actually like having some way to remember what session I'm looking at; just not sure about having both lines or having the "cut" verbiage, and it would be good to use our standard titles. @lzim @dlkibbe

branscombj commented 5 years ago

@AnnHier @lzim @staceypark @TomRust @dlounsbu @dlkibbe Sessions 5-10 are module-specific, so although they have the title slide for the 12-session plan, they also have a blue banner title after that identifying the module. I just noticed that that bar shows up in Session 4 (~0:07-0:10) saying Psychotherapy. There should be no title banner like that for sessions 1-4, 11, or 12. Let's be sure there aren't, and double check that the correct module is named for all the sessions 5-10.

branscombj commented 5 years ago

@lzim @dlkibbe @TomRust @AnnHier @dlounsbu in Session 6 CC at 24:59 You demonstrate entering Q text, then show and describe "Save and Reset". We want this to be the start of the BC run and in the Done Do review we show Save (not reset). Might be worth a popup for LZ: "Oops! Better if you hit Save at top right so you can resume this run later."

A small mis-speak at 13:57 in 06 CC probably not worth a pop-up LZ: "Oops! I mean Patients per week."

Here are all the Pause text and times for the Session 6 videos. Note that they do not always occur in the same order - that's not a mistake; it's just how the video was presented.

Message	6 SP	6 CC	06 MM	06 PSY	06 AGG
Pause and open the learner guide at mtl.how	0:51	0:56	0:52	0:37	0:36
Pause and log in at mtl.how/sim to follow along	3:10	3:10	3:20	2:36	2:36
Pause and review "i" for diagram variables	10:58	11:22	11:26	12:34	24:21
Pause and review "i" for experiment variables	11:58	14:48	10:59	(n/a)	16:24
Pause and review more systems stories in the diagram	25:22	17:32	22:00	22:41	23:25
Pause and log in to mtl.how/sim	28:57	20:11	27:00	26:27	27:03
Pause and enter your Question in the sim UI text box	30:53	22:07	28:40	28:10	28:59
Pause and enter your Hypothesis in the sim UI text box	32:14	23:26	29:54	29:42	30:17

dlkibbe commented 5 years ago

@AnnHier I don't see Session 5 PSY - can you please upload?

branscombj commented 5 years ago

@dlkibbe it’s the one that only says “cut” in the title

dlkibbe commented 5 years ago

Thanks @branscombj realized that after post. Sorry @AnnHier

branscombj commented 5 years ago

@lzim @dlkibbe @AnnHier @dlounsbu @TomRust

Message	Session 07 CC
Pause and open the learner guide at mtl.how	0:47
Pause and log in at mtl.how/sim	2:31
Pause and enter your Question.	5:21
Pause to enter your Hypothesis and save your work	16:45
Pause to Run the sim and enter your Findings	25:21
Pause and enter your Decision	28:55
Correction?	~25:xx We’re looking at the results and struggling to explain the oscillation (though small empirically) – We do not mention the observed immediate jump from 32 to 34 in starting rate. We kept Use Team Data on, and the number in the table is 32. Might help to explain why the output chart shows 34?

Done/Do for Session 07:

When LZ says we can use the shortcut we “showed in Session 7” about pulling up a prior run. Don’t think we’ve introduced that – but probably small and should just leave it alone.
Also in this demo, the run pulled up to show BC is a sim that hasn’t been run - as we can see when she goes to save it – which is why the results dashboard shows empty graphs. This deserves a comment. I suggest a correction popup, LZ: “You will see your 2-year results if you pull the right BC – the one you actually ran.” Could even have a little picture of a results dashboard with BC charts like you should see.

dlkibbe commented 5 years ago

@AnnHier Session 5 video notes mtl_Session 5 Video_Notes_dk.docx

dlkibbe commented 5 years ago

@AnnHier Session 8 video notes - I may have too many pop ups, delete as needed. @lzim Check pop-up text for Dynamic Hypothesis and Sankey Chart descriptions - edit or delete? mtl_Session 8 Video_Notes_dk.docx

dlkibbe commented 5 years ago

@AnnHier a couple of Session 11 notes mtl_Session 11 Video_Notes_dk.docx @lzim take out or keep & edit mention of Team Reports?

TomRust commented 5 years ago

I've made it though all the session 9 videos. Everything looks & sounds good! No errors or clarifications worthy of a pop-up. I'm going back in to record the time stamps for the "pause to..." popups, and will post a link to those tomorrow (Tuesday, the 19th).

AnnHier commented 5 years ago

@AnnHier Just wondering if these titles will remain, and if so, if we might be able to edit them? I actually like having some way to remember what session I'm looking at; just not sure about having both lines or having the "cut" verbiage, and it would be good to use our standard titles. @lzim @dlkibbe

Hi Jane - that's just a way for the person uploading the files to remember them. The Cut 1 verbiage refers to the fact it's the first draft. It can be changed.

AnnHier commented 5 years ago

@AnnHier @lzim @staceypark @TomRust @dlounsbu @dlkibbe Sessions 5-10 are module-specific, so although they have the title slide for the 12-session plan, they also have a blue banner title after that identifying the module. I just noticed that that bar shows up in Session 4 (~0:07-0:10) saying Psychotherapy. There should be no title banner like that for sessions 1-4, 11, or 12. Let's be sure there aren't, and double check that the correct module is named for all the sessions 5-10.

Got it - will have that banner removed for session 4.

AnnHier commented 5 years ago

@dlounsbu @TomRust @dlkibbe @branscombj @lzim

@branscombj raised a great point that we missed at the Launch call this morning. We're looking to give @AnnHier pop-up information not just for edits on corrections/fixes, but also for places the learner should stop and pause to do something (experiment runs, check out resources, etc.):

When drafting these edits for Ann, folks should also keep in mind...

Adding a specific ask to these pop-ups

Adding related iconography to the ask (i.e. the green play man for asks related to running the sim experiments)

@AnnHier Just to double check on the Pause buttons...

Double check - Are these also including the facilitators' faces just like the other pop-ups? If they are not, we would like for them to have the little photos of facilitators in these pop-ups as well

Heads up - We are also looking to add a specific add and related iconography to the non-correction pop-ups as you can see above.

Hi @staceypark, can do - do you or does @lzim have image files of these icons when you reference them in the popups? And yes, we can have the facilitators faces on the pause buttons.

AnnHier commented 5 years ago

Hi team, is everyone finished with their reviews? I am going to attempt to compile everyone's notes into one master document so I don't confuse our editor, unless someone is already doing this. :) Let me know - thanks!

branscombj commented 5 years ago

Hi team, is everyone finished with their reviews? I am going to attempt to compile everyone's notes into one master document so I don't confuse our editor, unless someone is already doing this. :) Let me know - thanks!

@AnnHier @lzim @dlkibbe @TomRust @dlounsbu @staceypark - I will start a compilation of all the pause and correct pop-ups. I want to do it offline in a spreadsheet so we can review for patterns and make decisions once as a group on repeated pause language and specific corrections. I have 4 more session 07s to review and annotate; David and Tom have not posted pop-ups for theirs yet; and I think Debbie may have 1 or 2 left to do. Y'all keep posting them here and I'll grab them as I see them. I'm going to put an icon on the comment once I've pulled from it (the one that looks like a propeller but I think is a marker?).

Once we have the spreadsheet, we can put the links to icons in it as well.

dlkibbe commented 5 years ago

@AnnHier just realized I didn't include in my Session 5 for MM the correction noted above...At 13:05 LZ makes note of an "Explorer" file - it should be an "Excel" file. Perhaps we can put a note on the screen.

lzim commented 5 years ago

Great, thanks @branscombj for compiling for @AnnHier, however, will you be able to copy your table to this issue thread so that others who are wrapping up their reviews can add to it? Your table above looks great!

branscombj commented 5 years ago

Great, thanks @branscombj for compiling for @AnnHier, however, will you be able to copy your table to this issue thread so that others who are wrapping up their reviews can add to it? Your table above looks great!

@lzim I am grabbing from here to add to the spreadsheet and can re-paste it here when I'm done. It's far more efficient and less susceptible to coding errors than compiling it formatted as a table within an Issue comment.

I am also compiling a list of decisions we need to make that address recurring themes. That I will post in a comment here.

dlkibbe commented 5 years ago

Great catch @branscombj with regard to the blue bar titles! @AnnHier Session 1, Session 2, Session 3, Session 11 and Session 12 all have Psychotherapy appearing in the blue bar at the bottom of the screen from about 07 to 12 seconds into each of these videos. @branscombj notes no blue bar should appear but if the blue bars are going to be appear for consistency, I believe they should have the title of the session. @lzim for sessions 2 and 3 titles, do you want a hyphen in "user-interface" as it currently appears or "user interface" with no hyphen.

lzim / teampsd

MTL.how video links! #294

For the latest MTL Video links, please:

1) go to https://mtl.how/documents

2) find the depend_products column on the far right

3) click on the relevant session & the video link will be at the top