Operations - Add 'completes' category to TO6 bar chart

[robertsamm]

Requestor(s): Amelia on behalf of Kristin at KPNW

Figure: Total Expected recruits vs Actual Verified Recruitments vs. Numbers of Blood Collections till 2023−05−01

Metrics to be updated: Weekly Operations Report

Variables Needed: Variables that show number 'complete' for research sites=initial survey + any blood, urine, and mouthwash collected for clinical/KP sites=initial survey + any blood and urine (no mouthwash) Please use same variables/definitions used in weekly log for 'completes'

Notes: Hi Jing, the KPs requested that we add to this bar chart an additional category to track 'completes' against the TO6 goals. All the other categories will stay the same but you will need to add a 4th category for completes. Please use the same variables to calculate this that you used in the weekly log. Please also add a footnote that states: 'Completed=all 4 sections of the initial survey + samples donated (for research collections: urine, mouthwash, and any blood is collected; for clinical collections: urine and any blood collected).

Approved by: Michelle

Addtl Note: Jing, please only post metrics you are currently working on to the CCC/DCEG Box folder, once update is approved then can go into ALL.

[jeannewu]

Hi, Amelia,

So you would like this one:

Table 28. Time From Incentive Eligible to Incentive Issued by NORC in Days Site Incentives Issued min q1 median mean sd q3 max HealthPartners 698 0.02 0.21 0.46 3.24 7.89 2.16 104.69 Henry Ford Health System 268 0.02 0.24 0.87 3.15 8.13 1.83 76.36 Marshfield Clinic Health System 431 0.03 0.24 0.74 3.82 9.91 2.00 70.01 Sanford Health 260 0.03 0.22 0.62 2.72 6.93 1.64 56.24 Kaiser Permanente Colorado 246 0.01 0.10 0.28 2.41 5.15 1.20 28.36 Kaiser Permanente Georgia 126 0.01 0.11 0.83 1.80 3.34 1.67 17.68 Kaiser Permanente Hawaii 192 0.00 0.77 0.99 2.27 5.21 1.33 58.17 Kaiser Permanente Northwest 304 0.01 0.28 0.96 2.08 3.55 1.68 27.99 Total 2525 0.00 0.21 0.85 2.91 7.28 1.78 104.69 Note: For all sites except Chicago Right? I will update this table soon.

Best, Jing From: Amelia Roberts @.> Date: Thursday, May 4, 2023 at 5:41 PM To: Analyticsphere/metricsReportsRequests @.> Cc: Wu, Jing (NIH/NCI) [C] @.>, Assign @.> Subject: [EXTERNAL] Re: [Analyticsphere/metricsReportsRequests] Operations - Add 'completes' category to TO6 bar chart (Issue #28)

Assigned #28https://github.com/Analyticsphere/metricsReportsRequests/issues/28 to @jeannewuhttps://github.com/jeannewu.

— Reply to this email directly, view it on GitHubhttps://github.com/Analyticsphere/metricsReportsRequests/issues/28#event-9171866893, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AXZVEF25AEPWIAD3QP5CTRTXEQPAXANCNFSM6AAAAAAXWK5UPA. You are receiving this because you were assigned.Message ID: @.***> CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender and are confident the content is safe.

[jeannewu]

Hi, Amelia,

Thank you very much for your helpful request via github.

As you described for the completion in Table 13, I have just updated this table (shown below) for the completions by clinical and research biocollections. If correct, I will update Table 13 as below in this week’s report soon. Thanks a lot.

Best, Jing Table 13. Completion of Baseline Survey and All Three Baseline Samples Among Verified Participants Completion of Baseline Survey and Sample Collections Yes No Total Verified Participants Site HealthPartners 738 (52.60%) 665 (47.40%) 1,403 Henry Ford Health System 272 (43.38%) 355 (56.62%) 627 Marshfield Clinic Health System 452 (64.11%) 253 (35.89%) 705 Sanford Health 276 (61.74%) 171 (38.26%) 447 University of Chicago Medicine 601 (54.89%) 494 (45.11%) 1,095 Kaiser Permanente Colorado 255 (18.46%) 1,126 (81.54%) 1,381 Kaiser Permanente Georgia 134 (19.76%) 544 (80.24%) 678 Kaiser Permanente Hawaii 206 (41.37%) 292 (58.63%) 498 Kaiser Permanente Northwest 330 (20.87%) 1,251 (79.13%) 1,581 Total Verified Participants 3,264 (38.79%) 5,151 (61.21%) 8,415 Note: Completion=yes if all 4 sections of the initial survey are completed and samples donated (for research collections: urine, mouthwash, and any blood is collected; for clinical collections: urine and any blood collected)

From: Amelia Roberts @.> Date: Thursday, May 4, 2023 at 5:41 PM To: Analyticsphere/metricsReportsRequests @.> Cc: Wu, Jing (NIH/NCI) [C] @.>, Assign @.> Subject: [EXTERNAL] [Analyticsphere/metricsReportsRequests] Operations - Add 'completes' category to TO6 bar chart (Issue #28)

Requestor(s): Amelia on behalf of Kristin at KPNW

Figure: Total Expected recruits vs Actual Verified Recruitments vs. Numbers of Blood Collections till 2023−05−01

Metrics to be updated: Weekly Operations Report

Variables Needed: Variables that show number 'complete' for research sites=initial survey + any blood, urine, and mouthwash collected for clinical/KP sites=initial survey + any blood and urine (no mouthwash) Please use same variables/definitions used in weekly log for 'completes'

Notes: Hi Jing, the KPs requested that we add to this bar chart an additional category to track 'completes' against the TO6 goals. All the other categories will stay the same but you will need to add a 4th category for completes. Please use the same variables to calculate this that you used in the weekly log. Please also add a footnote that states: 'Completed=all 4 sections of the initial survey + samples donated (for research collections: urine, mouthwash, and any blood is collected; for clinical collections: urine and any blood collected).

Approved by: Michelle

Addtl Note: Jing, please only post metrics you are currently working on to the CCC/DCEG Box folder, once update is approved then can go into ALL.

— Reply to this email directly, view it on GitHubhttps://github.com/Analyticsphere/metricsReportsRequests/issues/28, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AXZVEFZBJQ2CCOGFBNPDXD3XEQPAVANCNFSM6AAAAAAXWK5UPA. You are receiving this because you were assigned.Message ID: @.***> CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender and are confident the content is safe.

[jeannewu]

Hi, Amelia,

Here attached is a copy of the updated weekly report of this week.

The Table 13, 28 and 36-28 are all updated as requested. Thank you very much for helping me improve this report.

I’ve put this updated report in the Box: Connect Reports_DCEG ONLYhttps://nih.app.box.com/folder/141539955232\Metric Reports_DCEGhttps://nih.app.box.com/folder/141543190265\Weekly Metric Reports_CCC https://nih.app.box.com/file/1203973658412

Now I am going to create the new table (Table 30: Number of Active Verified Participants that Enrolled Passively) https://github.com/Analyticsphere/metricsReportsRequests/issues/27 as requested. Hope I can get it done this week and show it in next week’s report.

Please check them and let me know if anything is needed. Thanks a lot.

Best, Jing

From: Wu, Jing (NIH/NCI) [C] @.> Date: Thursday, May 4, 2023 at 9:02 PM To: Analyticsphere/metricsReportsRequests @.>, Analyticsphere/metricsReportsRequests @.> Cc: Assign @.> Subject: Re: [EXTERNAL] [Analyticsphere/metricsReportsRequests] Operations - Add 'completes' category to TO6 bar chart (Issue #28) Hi, Amelia,

Thank you very much for your helpful request via github.

As you described for the completion in Table 13, I have just updated this table (shown below) for the completions by clinical and research biocollections. If correct, I will update Table 13 as below in this week’s report soon. Thanks a lot.

Best, Jing Table 13. Completion of Baseline Survey and All Three Baseline Samples Among Verified Participants Completion of Baseline Survey and Sample Collections Yes No Total Verified Participants Site HealthPartners 738 (52.60%) 665 (47.40%) 1,403 Henry Ford Health System 272 (43.38%) 355 (56.62%) 627 Marshfield Clinic Health System 452 (64.11%) 253 (35.89%) 705 Sanford Health 276 (61.74%) 171 (38.26%) 447 University of Chicago Medicine 601 (54.89%) 494 (45.11%) 1,095 Kaiser Permanente Colorado 255 (18.46%) 1,126 (81.54%) 1,381 Kaiser Permanente Georgia 134 (19.76%) 544 (80.24%) 678 Kaiser Permanente Hawaii 206 (41.37%) 292 (58.63%) 498 Kaiser Permanente Northwest 330 (20.87%) 1,251 (79.13%) 1,581 Total Verified Participants 3,264 (38.79%) 5,151 (61.21%) 8,415 Note: Completion=yes if all 4 sections of the initial survey are completed and samples donated (for research collections: urine, mouthwash, and any blood is collected; for clinical collections: urine and any blood collected)

From: Amelia Roberts @.> Date: Thursday, May 4, 2023 at 5:41 PM To: Analyticsphere/metricsReportsRequests @.> Cc: Wu, Jing (NIH/NCI) [C] @.>, Assign @.> Subject: [EXTERNAL] [Analyticsphere/metricsReportsRequests] Operations - Add 'completes' category to TO6 bar chart (Issue #28)

Requestor(s): Amelia on behalf of Kristin at KPNW

Figure: Total Expected recruits vs Actual Verified Recruitments vs. Numbers of Blood Collections till 2023−05−01

Metrics to be updated: Weekly Operations Report

Variables Needed: Variables that show number 'complete' for research sites=initial survey + any blood, urine, and mouthwash collected for clinical/KP sites=initial survey + any blood and urine (no mouthwash) Please use same variables/definitions used in weekly log for 'completes'

Notes: Hi Jing, the KPs requested that we add to this bar chart an additional category to track 'completes' against the TO6 goals. All the other categories will stay the same but you will need to add a 4th category for completes. Please use the same variables to calculate this that you used in the weekly log. Please also add a footnote that states: 'Completed=all 4 sections of the initial survey + samples donated (for research collections: urine, mouthwash, and any blood is collected; for clinical collections: urine and any blood collected).

Approved by: Michelle

Addtl Note: Jing, please only post metrics you are currently working on to the CCC/DCEG Box folder, once update is approved then can go into ALL.

— Reply to this email directly, view it on GitHubhttps://github.com/Analyticsphere/metricsReportsRequests/issues/28, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AXZVEFZBJQ2CCOGFBNPDXD3XEQPAVANCNFSM6AAAAAAXWK5UPA. You are receiving this because you were assigned.Message ID: @.***> CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender and are confident the content is safe.

[robertsamm]

Hi Jing, table 13 for completes looks good but this github issue is for a different metric. This is for the bar graph titled 'Total Expected recruits vs Actual Verified Recruitments vs. Numbers of Blood Collections till 2023−05−01'

[jeannewu]

Amelia @robertsamm, So the table 13 is updated with the completions. Will you think it ok? And for this Figure2, please help check this plot? Will you think it ok after the completion bars of each site are included! THX, Jing image

[robertsamm]

Hi Jing, thanks for adding in the completion bars for Figure 2. I think this one still needs a bit more work. The colors are starting to make it look visually confusing. Here are my suggestions below, unless @miagaudet wants something different because this metric was originally requested by her.

1. Please don't offset the color of the bar with the outline (e.g. it should be purple on purple, not purple outlined with green)
2. If possible, make it so the colors of the different bar categories don't blend together (for ex the green for completes in the bar is a completely different color than the legend bc it 'mixes' with the pink/purple)
3. Please make it so that the numbers are in alignment
4. Can you move the key over to the right a bit so it isn't cutting off the TO6 number for KPNW? MF and SFs targets are much lower so could move it to be over them

@miagaudet here is the updated Figure 2 for your review: https://user-images.githubusercontent.com/99832343/236528214-73a0ffeb-d22a-438a-85af-88dbcbba5a24.png

[robertsamm]

Also @jeannewu can you share how you are calculating the blood collection for UChicago? I'm surprised to see that their 'blood' and 'completion' counts are so close together.

[jeannewu]

Amelia @robertsamm , the blood collection by site is calculated and counted with "d_878865966==353358909" in each site.

[robertsamm]

Thanks @jeannewu that looks right for blood, thanks for sending so I could doublecheck! Then just need to address the other comments above.

[jeannewu]

Hi, Amelia @robertsamm Thanks a lot. It is hard to stack and align the texts of numbers of the completion, blood counts, verified, and expected in each bars, since some of their counts are quite close which makes their corresponding text overlapping. To make it clear, I have to switch their text positions in the plot, (shown here). Please give me some ideas and comments to make the plot much clearer and prettier. Thanks

[robertsamm]

Hi @jeannewu gotcha, I see what you mean about the numbers being too close together. Although it does look like for most of them you would be able to stack them. For the colors of the bars/legend - can you make it so they are not transparent/blend in to each other? For ex right now the 'completion' category is tan in the legend but in the actual bar graph it looks coral bc you have the colors blending in with each other (it actually makes it look like the coral color in the legend for 'blood).

For each color/category - please make it so the colors aren't transparent and also turn off the different colored outline. I would also change the 'completion' color to something other than tan.

[jeannewu]

Hi, Amelia, How about this plot after I adjusted the colors and text position in the plot as you suggested

[robertsamm]

Hi Jing, no the colors are still blending together/transparent so they don't match the legend and still have a different colored outline. Perhaps reach out to @KELSEYDOWLING7 for ideas on how to code the bar graph colors?

[jeannewu]

this one?

[jeannewu]

I think this one might be better.

[robertsamm]

Hi @jeannewu please touchbase with @KELSEYDOWLING7. I see in the Biospecimen Report Figure 1, she has a stacked bar chart where, while it doesn't have as many categories, the category colors look neater -they don't have an outline and aren't transparent/don't blend together to create a different color than what the legend shows.

It's 4:30pm on a Friday, feel free to pick this back up next week so you can enjoy your weekend. It's not an urgent request. For Monday's report please use the chart from this past Mondays report without the 'completes' until we've settled on an updated figure.

[jeannewu]

Hi, Amelia, this plot is to present the progress from completion, through blood collection among the recruited verified participants to the target number of the recruitments in each site. For each site, the bars of each status(completion, blood collection, actual verified participants, expected participants to be recruited) are overlapped from the baseline, in which their colors of each status are overlapped and their corresponding text are shown the total counts of each bar or the length of each status. In this case, I try to lower the effects on the potential colors mixture which the bars are overlapped with its adjacent bars and make the legend color of each category close to the actual color in the plot.

[robertsamm]

@miagaudet and @FrogGirl1123 to review and provide feedback on next. Latest update can be found in here for Figure 3: https://nih.app.box.com/file/1208900552119

[jeannewu]

Hi, Mia, Nicole, Michelle and Amelia

Thank you very much for your helpful comments.

I have updated the Fig3 with Mia’s helpful comments on the text of each layer over the bars of each site along with other updates (approved) in this updated weekly report (attached).

Please review them (especially the Fig3) and let me know if any other is needed. This is the most updated version noted in the file name. If ok, I will put this one in the corresponding folder in box.

Thanks a lot.

Best, Jing

From: Amelia Roberts @.> Date: Tuesday, May 9, 2023 at 4:14 PM To: Analyticsphere/metricsReportsRequests @.> Cc: Wu, Jing (NIH/NCI) [C] @.>, Mention @.> Subject: [EXTERNAL] Re: [Analyticsphere/metricsReportsRequests] Operations - Add 'completes' category to TO6 bar chart (Issue #28)

@miagaudethttps://github.com/miagaudet and @FrogGirl1123https://github.com/FrogGirl1123 to review and provide feedback on next. Latest update can be found in here for Figure 3: https://nih.app.box.com/file/1208900552119

— Reply to this email directly, view it on GitHubhttps://github.com/Analyticsphere/metricsReportsRequests/issues/28#issuecomment-1540831900, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AXZVEFY6NMAT3C2EM6AZOZTXFKQSFANCNFSM6AAAAAAXWK5UPA. You are receiving this because you were mentioned.Message ID: @.***> CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender and are confident the content is safe.