TWE: Create Research Plan for RP20

[lkawentel]

Dependencies

• [x] A roadmap document has been created: #328
• [ ] Roadmap doc details has been created #380
• [x] A research setup structure (wiki, GitHub labels, Google Drive, etc.) has been created and approved.

Overview

We need to create a Research Plan for Intern Interaction with HfLA Teams so that we can conduct generative, exploratory research on the HfLA volunteers who interacted with the interns.

Action Items

• [x] Update this issue to make sure it's properly categorized and easy to manage
  • [x] Add to the Project Board (helps with Project Management overview)
  • [x] Add the milestone: Research Plan Creation (helps with prioritization)
  • [x] Add label of the correct research plan number associated with this research plan (e.g., Research: RP001) (helps you find related issues in the same workflow)
  • [x] Edit title of issue with the correct research plan number (same as prior)
  • [x] Edit placeholders in Overview of this issue with the relevant information in square brackets. (personalizes the issue to make it easier to read). Any place you see [replace...] replace both the text and the brackets with what it is asking for (including in the front matter above but not where it says name, but not where it says title.
• [x] Update this issue with the relevant Resources:
  • [x] Go to the Research Output Overview Page (link in Resources) and find the relevant overview type wiki page. Then, change [Wiki [TYPE] Research Overview Page] in the Resources below with the correct wiki page of the research overview by type.
  • [x] Go to the Research Output Overview Page again and find the relevant wiki page for this specific research plan. Then, change the [RP__ Wiki Page] in the Resources below with this RP's specific wiki page.
  • [x] Find and link the folder you are going to put your research plan in (e.g., Research by Type>2. Intern>RP6 - Intern Intake Interviews)
    • [x] Go to the Google Drive's Research by Type Folder (link in Resources)
    • [x] Go into the relevant Type Folder (e.g., 1. Mentor, 2. Intern, etc.)
    • [x] once inside, right-click on the relevant destination folder and copy the link. (e.g., RP6 - Intern Intake Interviews)
      • [x] Add the Google Drive link in the Resources below with the link you just copied and revise the display text to include the Research Plan number (e.g., Google Drive RP__ Folder to Google Drive RP008 Folder)
• [x] Create the Research Plan Document.
  • [x] Make a new document using the TWE Research Plan template (link in Resources). Follow the instructions in the How To Write a Research Plan guide (link in Resources) and mark your progress in this issue.
  • [x] Move your document from "My Drive" to the shared drive internship folder of this specific RP.
  • [x] Name your document to be called "TWE: RP___ : [TITLE OF RESEARCH] Research Plan".
  • [x] Update the document with the relevant information in accordance with the research roadmap document (found on the Research Overview Page).
  • [ ] Update the Table of contents (page 2) when you are finished with the document.
• [ ] Meet and sign-off research plan document with UX Research lead (by adding it to the research team meeting agenda).
• [ ] Update RP Wiki Page with any changes or corrections.
• [ ] Once research lead has signed off, add it to the PM/Research lead agenda
• [ ] sign-off by PM
• [ ] Does this issue have any dependency checkboxes in the action items here?
  • [ ] if yes, remove dependencies that are listed below (issues that are waiting on this issue to be completed. Sometimes they have already been made and sometimes they yet to be made).
    • [ ] close this issue
  • [ ] if no, check to see if the follow-up issues have already been made (see related structure issue). If new issues have not been made, then apply label ready for research lead and define what needs to be done in a comment below
    • [ ] close the issue
    • [ ] move to Question/Review Column

Resources

• Wiki Research Output Overview Page
• Wiki Other HfLA Team Research Overview
• RP20 Wiki Page
• Google Drive Research by Type Folder
• Google Drive RP20 Folder
• Research Plan Template
• How to Write a Research Plan

Research Plan

• TWE: Research Plan: RP020 Intern Interaction with Hack for LA Teams

[bradyse]

@lkawentel

Please provide update

1. Progress: "What is the current status of your project? What have you completed and what is left to do?"
2. Blockers: "Difficulties or errors encountered."
3. Availability: "How much time will you have this week to work on this issue?"
4. ETA: "When do you expect this issue to be completed?"
5. Pictures (if necessary): "Add any pictures that will help illustrate what you are working on."

[sharongupta1]

This issue does not have the name of the research plan and can't be prioritized until it does. We added the text 'Draft' to the title, please remove when you completed creating the issue. Let Sara know when you are ready for her to review the issue @bradyse @lkawentel

[bradyse]

We updated the content of the issue and unassigned Linda so that she can work on an analysis demo for rapid research to be given at our next UXR team meeting.

[dialectic51]

1. Progress: Just started on the issue.
2. Blockers: Need to determine if it would make more sense to send out a survey instead of conducting interviews (Bonnie would need to make this decision; see below)
3. Availability: 6 hours
4. ETA: By end of week; but possible that it will require more time

More on blockers: In our meeting on Tuesday, we discussed that it might make more sense to conduct a survey, with the availability of open-ended responses, instead of qualitative interviews. This is because, since it has been 6 months or so since the events transpired, it is unclear what information we could get in an interview that we couldn't get using a survey (with the option of filling in open-ended responses). Moreover, we would likely get a higher response rate to a survey (it can be done at any time and requires less of a time commitment than an interview). After we receive the survey responses, if necessary, we could then follow-up with those individuals whose responses makes us think they might have more to say if we conducted an interview.

[dialectic51]

Spoke to Bonnie at All Team Meeting, where she made the following points with regard to the concerns I raised in my previous comment:

POINTS MADE:

• Sending out a survey won't necessarily give a better response rate. In fact, in the past, requesting an interview has resulted in a much higher response rate (people value the human interaction).
  • Therefore, plan to conduct semi-structured interviews as noted in the RP020 research plan contained in the google drive.
• We have a spreadsheet in the google drive that lists all of the pull requests and other interactions between HfLA volunteers and interns (both working on the website).

TO DO:

• Need to 1.) craft the set up/introductory message for volunteers (i.e., request for participation) and 2.) the interview questions.
  • During the interview, the interviewer will share the information from the spreadsheet (on intern-volunteer interactions) with the volunteers, and then have the volunteers use the "talk aloud" method as they review their pull requests and other interactions with the interns (i.e., say out loud the thoughts they have about the intern and their interactions with them).
  • Finally, ask the interview questions.

[dialectic51]

Progress: I have started revising Research Plan: RP020 making detailed comments to the document (where questions exist) and filling out the unfinished portion of the Research Plan.

• identified KPI's for each of the research objectives
• put together a proposed timeline for completing the research
• added 3 appendices.
  • Appendix I is the script for recruiting participants (complete draft).
  • Appendix II is an outline of the interview protocol. It includes Likert-scale questions for measuring KPI's, but the interview questions still need to be written.
  • Appendix III will be the consent form. (I am waiting for the consent form template to be completed, which I will then use to create the text for the consent form).

Blockers: I will need the lead UXR and Bonnie to review my contributions and suggest changes. I'm waiting on the creation of the consent form template, but if its creation is delayed, I can go ahead and write up a consent form so that we can start the recruitment process.

Availability: 6 hours

ETA: I should be able to write out some of the actual interview questions next week prior to Tuesday's UXR meeting.

[dialectic51]

Progress: Attempted to fix the Objectives and KPI's based on Bonnie's feedback; not successful.

• (Note: Objectives and KPI's should be based on the research roadmap, not the research objectives and research questions listed in RP020).

Blockers:

• 1.) Unclear what the purpose of the "Goals and Metrics" section of RP020 is, which contains the Objectives and KPIs.
  • 1a.) How will the information listed in this section impact or shape the interviews we will collect?
  • 1b.) Can we proceed with conducting the interviews (time sensitive) before we figure out the KPIs?
• 2.) TWE Research Roadmap: Other HfLA Team Research doesn't provide enough information to create Objectives or KPIs--it is currently a template whose content needs to be filled in.
  • 2a.) There is no mention of Objectives or KPIs in the Research Roadmap
• 3.) Should the quantitative metrics listed in the wiki for Research Plan 20: Intern Interaction with HfLA Teams be included in the Research Plan for RP020?
  • 3a.) Does the quantitative data need to be collected or analyzed before we conduct the interviews?
  • 3b.) Currently, RP020 only employs qualitative methods (that are "based upon the quantitative data collected.")
  • 3c.) If the collection and analysis of the quantitative metrics are not part of RP020, are KPI's necessary?
• To sum up, can we move forward with conducting the interviews before resolving the Objectives and KPIs in the Goals and Metrics section?

Availability: 6 hours (or more if needed).

ETA: Need clarification on questions listed under Blockers.

• I can't make Thurs (3/2) meeting. Contact me if there are any questions about my update.
• I should be able to work on interview questions in the meantime.

[dialectic51]

Progress:

• I have been working with Ying to fill out the TWE: Research Roadmap: HfLA Volunteers.
  • I will look at the Roadmap for Interns as an example to follow.
• I have written out a draft of the interview protocol, including interview questions, for TWE: Research Plan: RP020

Blockers

• The TWE: Research Roadmap: HfLA Volunteers document needs to be completed before the TWE: Research Plan: RP020 can be completed.
  • The TWE: Research Roadmap: HfLA Volunteers document needs to be reviewed by Bonnie
• Still unclear what the purpose of the "Goals and Metrics section of RP020 is. See questions 1 and 2 in my comment above.
• Should also clarify the relationship of the quantitative metrics we plan to collect to RP20. See question 3 in my comment above

Availability: 6 hours

ETA: Hoping to have Roadmap and RP20 finalized by next week.