search

hackforla / tdm-calculator

DTLA Hack for LA is partnering with Los Angeles Department of Transportation (LADOT) to develop a Traffic Demand Management (TDM) calculator tool. This tool will help planners at LADOT and real estate developers to meet the Los Angeles’s Mobility Plan goals by 2035.
https://tdm.ladot.lacity.org
GNU General Public License v2.0
49 stars 33 forks source link

Make Template from Audited Documents Part 2: determine and make necessary changes #1029

Closed Jane4925 closed 2 years ago

Jane4925 commented 2 years ago

Overview

Read through all need-to-be-templated documents, think about possible changes, and edit/comment on changes in the documents.

Action Items

For each document:

Resources/Instructions

  1. Check wiki page for descriptions of each document and corresponding section/subsection numbers
  2. Refer to items in Needs Template Audit
  3. Ask Jane in the comment/slack if you need help/support/work-along sessions
pmeda12 commented 2 years ago

I have finished making the templates. Jane, please provide feedback when you can.

jarmitageux commented 2 years ago

In Tool Set Up looks like we're considering renewal of Otter.ai for testing transcription.

Could we look at Dovetail as alternate tool option? It has been recommended to me for quickly grabbing video clips, voice transcription with in-line theming, etc which could save tons of time and produce assets to show stakeholders. Could we check cost/features compared to Otter.ai tool?

jarmitageux commented 2 years ago

@Jane4925 In the research folder, I see the File named Template audit from Q1 activity and the Sheet named Needs Template Audit, but there are no items listed for my section (4). Do you have the previous sheet we reviewed last Saturday with the notes re: reason to update?

Jane4925 commented 2 years ago

@jarmitageux oops, I checked something yesterday and forgot to change the filter back to "yes". It should work now, reload and see if it is back to normal

jarmitageux commented 2 years ago

@Jane4925 Thanks so much! That fixed it.

jarmitageux commented 2 years ago

I'd like to discuss file titles. I think the titles used in column C of the template audit spreadsheet are more clear than the current document titles and file names.

jarmitageux commented 2 years ago

Recommend updating wiki - Interview Materials, Tools Set Up: Zapier to add: Zapier : used to do the automated posting to our slack channel when someone chooses a time in Calendly

jarmitageux commented 2 years ago

@Jane4925 RE: TDM Calculator Usability Testing Discussion Guide [Draft] [TEMPLATE]

Ready for your review.

jarmitageux commented 2 years ago

@Jane4925 RE: TDM Usability Testing - Internal Documentation [Draft] [TEMPLATE]

Ready for your review. I reviewed and made updates taking into account our last discussion.

Jane4925 commented 2 years ago

@Jane4925 RE: TDM Calculator Usability Testing Discussion Guide [Draft] [TEMPLATE]

Ready for your review.

  • How do I get to the Bonus Package page? Image and section needs updating pending page review.
  • Made edits primarily attempting to avoid leading questions and jargon.
  • Are UXRs supposed to be tracking time to complete tasks? If so, should we add a row for that for each task?
  • How are UXRs advised/preferred to enter notes/observations? In rows or columns? To prepare for analysis, it might help to make this clear on the form and in our training.
  • I'm not sure what functions have been changed on the tdm calculator since the last test round. Do you think having interviewees use the site as instructed to enter their projects will reveal issues with new features without specifically identifying them in the testing guide? It seems this might be the case. Please let me know if there are other updates you'd like me to make to the guide, or if we should review together with your knowledge of site iterations.

@jarmitageux 1）You can reference a sample project to get to the Bonus package page. I believe that minor changes are under development, so no worry to update the images now. Instead, just annotate [insert bonus package page image]. 2) UXRs should track approximate time that interviewees spend on each page. Adding a row to remind UXRs could be helpful to remind UXRs; make sure that it's clear for UXRs to understand the specific row is only for them but not the interviewees. 3) UXRs should make notes in the column where it said "Note." Feel free to brainstorm better ways for UXRs to enter notes and for us to analyze later on. 4) we will talk to the team about the new features to finalize the guide for second round of testing along the way. This template is more general so other rounds of testing can be modified based on it. Think about where are the questions that can potentially become a placeholder to update questions to revalidate old features and where are the spaces to add questions for new features.

Jane4925 commented 2 years ago

@pmeda12 I finished reviewing your sections. Could you check my comments and edits inside the docs and try to revise a bit (wording, tone, etc.)?

pmeda12 commented 2 years ago

Hi Jane, I will look at your comments as soon as I can!

jarmitageux commented 2 years ago

FYI - I was looking to see if rows were hidden in this worksheet, round 1 usabilty testing results, and it showed as being an updated version. No changes were made.

jarmitageux commented 2 years ago

@Jane4925 RE: TDM Calculator Usability Testing Discussion Guide [Draft] [TEMPLATE] Ready for your review.

  • How do I get to the Bonus Package page? Image and section needs updating pending page review.
  • Made edits primarily attempting to avoid leading questions and jargon.
  • Are UXRs supposed to be tracking time to complete tasks? If so, should we add a row for that for each task?
  • How are UXRs advised/preferred to enter notes/observations? In rows or columns? To prepare for analysis, it might help to make this clear on the form and in our training.
  • I'm not sure what functions have been changed on the tdm calculator since the last test round. Do you think having interviewees use the site as instructed to enter their projects will reveal issues with new features without specifically identifying them in the testing guide? It seems this might be the case. Please let me know if there are other updates you'd like me to make to the guide, or if we should review together with your knowledge of site iterations.

@jarmitageux 1）You can reference a sample project to get to the Bonus package page. I believe that minor changes are under development, so no worry to update the images now. Instead, just annotate [insert bonus package page image]. 2) UXRs should track approximate time that interviewees spend on each page. Adding a row to remind UXRs could be helpful to remind UXRs; make sure that it's clear for UXRs to understand the specific row is only for them but not the interviewees. 3) UXRs should make notes in the column where it said "Note." Feel free to brainstorm better ways for UXRs to enter notes and for us to analyze later on. 4) we will talk to the team about the new features to finalize the guide for second round of testing along the way. This template is more general so other rounds of testing can be modified based on it. Think about where are the questions that can potentially become a placeholder to update questions to revalidate old features and where are the spaces to add questions for new features.

@Jane4925 Thanks for these replies! 1) Done - Bonus Package image placeholder 2) I added time tracking fields/open to other ideas. It would be good to test it to see if it's clear and usable for UXRs. 3) TBD - I looked at the testing results worksheet from last round to see what analysis we are preparing for and I'm still thinking about what might work well.

jarmitageux commented 2 years ago

@Jane4925 RE: TDM Usability Testing - Researchers Documentation [Draft] [TEMPLATE]

Ready for your review.

  1. Suggested a new page title.
  2. Is tdm-ux slack channel still active, or correct reference, or should it be updated to tdm-calculator?
  3. I was confused by the reference to the landing page in instruction 3.c. Does this just refer to the page opened by the link in the worksheet? I want to make sure it's not confused with a landing page for the TDM Calculator site. Does it seem clear?
  4. I would recommend adding instructions for the UXR to guide the interviewee through sharing their screen and accessing the sample project etc, but I need help outlining this because I haven't done this on Zoom.
  5. Are our current files going to remain the same links for the testing? If so, I'll link them now. Otherwise, the Additional Info links will need updating once all the files are finalized.
pmeda12 commented 2 years ago

@Jane4925 I have reviewed your comments and replied to a few of them, and accepted the changes that you proposed. Overall, I agree with everything you said.

pmeda12 commented 2 years ago

@Jane4925 Just finished reviewing the documents assigned to @jarmitageux. I added a few comments / edits where I felt it was needed. Overall, I think Jill did an amazing job with synthesizing information and clarifying instructions in these documents. There were a few parts that I think can be further clarified that I can discuss in our meeting today at 4pm.

jarmitageux commented 2 years ago

@Jane4925 RE: TDM Calculator UXR Onboarding [Draft] [TEMPLATE]

Ready for your review. I had several questions about process, redundancies, and ordering that I posted as notes in slides. These might need more work.

jarmitageux commented 2 years ago

@Jane4925 RE: TDM Usability Testing - Researchers Documentation [Draft] [TEMPLATE]

Ready for your review.

1. Suggested a new page title.

2. Is tdm-ux slack channel still active, or correct reference, or should it be updated to tdm-calculator?

3. I was confused by the reference to the landing page in instruction 3.c. Does this just refer to the page opened by the link in the worksheet? I want to make sure it's not confused with a landing page for the TDM Calculator site. Does it seem clear?

4. I would recommend adding instructions for the UXR to guide the interviewee through sharing their screen and accessing the sample project etc, but I need help outlining this because I haven't done this on Zoom.

5. Are our current files going to remain the same links for the testing? If so, I'll link them now. Otherwise, the Additional Info links will need updating once all the files are finalized.

Reviewed and updated, added checklists and process phase titles to UXR Responsibilities Also added new content and comments that need review.

Jane4925 commented 2 years ago

Weekly format for updating issues

  1. Progress: finished reviewing Discussion Guide, working on the revising other docs
  2. Blockers: need to confirm some details with LADOT and PMs
  3. Availability: actively working on it everyday :)
  4. ETA: late Jan or early Feb
pmeda12 commented 2 years ago

UXR Notes from Team meeting:

pmeda12 commented 2 years ago

Progress: Reviewed Discussion Guide and Onboarding slide deck Blockers: need to confirm edit suggestions with Jane (mostly just deleting or moving slides) Availability: trying to work on it at least a little bit a day! ETA: Late Jan.

jarmitageux commented 2 years ago

@Jane4925 @pmeda12 Reviewed Discussion Guide. I was afraid to finalize without a record of notes, so I created a new document: Copy of... [Template]. Hopefully didn't just create a big mess. Done:

To do:

Jane4925 commented 2 years ago

Progress: 1) Finalizing documentations for UXR team and UXR volunteers 2) Polishing Discussion Guide and Volunteers Training slide deck Blockers: Havn't finish reviewing improved and new features since user testing 1 Availability: trying to work on it at least a little bit everyday and Sat team meeting ETA: Late Jan ~ Early Feb

jarmitageux commented 2 years ago

I renamed the User Testing Discussion Guide to keep us all editing the same file. Please make all reviews, comments, edits to: TDM Calculator Usability Testing Discussion Guide [TEMPLATE]-Current Active

jarmitageux commented 2 years ago

Progress: 90% done finalizing recruitment and testing assets, 75% done finalizing UXR training assets

Blockers:

Availability: daily progress, Sat team meetings

ETA: Start recruitment for UXR volunteers and testing participants by 3rd week Feb, start testing early March

Jane4925 commented 2 years ago

Action items as of 2/5 meeting:

pmeda12 commented 2 years ago

Progress: Updated Usability test scheduling email template to include reminder to have laptop/desktop and Created TDM Calculator logo to include on Google form survey (https://drive.google.com/drive/u/0/folders/11oC86fvFPgwRYsxbn7XCy6CdbK4MXSfT) Blockers: No major blockers ETA: Will complete HfLA logo for google form survey within next few days

Jane4925 commented 2 years ago

Progress: 1) Upgraded Zoom account 2) Discussion Guide and Volunteers Training slide deck 95% completed 3) Approved Volunteer recruitment form Blockers: 1) Haven't finish reviewing improved and new features since user testing 1 2) Feedback is received from stakeholder, but updates haven't been made yet 3) Deciding on training date and time Availability: trying to work on it at least a little bit everyday and Sat team meeting ETA: Aiming 100% Discussion Guide and Volunteers Training slide deck completion this Sat 02/19 and get feedback

pmeda12 commented 2 years ago

Progress: Finished consolidating last few slides of training slide deck, reviewed stakeholder comments on email templates and survey questions

Blockers: None

Availability: at least a little every day

ETA: Tasks are done, pending further comments from stakeholders (LADOT)

jarmitageux commented 2 years ago

@Jane4925 Review of last closing questions from round 1 testing:

Only 2 or 16 participants were asked those last 4 questions. Not asked because the sessions had run long, participant annoyed by too many questions, or tech glitches.

I didn’t save the answer, but my impression was that the question about concerns in the permitting process could be helpful.

I’m not sure I know enough about the use case for these answers to know if these are helpful, so here are the answers to the occupation and team questions.

Can you tell me more about your occupation? 1 - Yes, I am a transportation planner. I work for a company called co a and the Culver City Office. And so we do a lot. 2 - Yes, I work with a transportation consultancy and I assist one of the transportation management organizations go Glendale. So we work with employers and property managers to give our transit information and I also work with some of the other rail projects.

Can you tell me about your team? 1 - So we have a small office, there's about 11 of us. But it's comprised of a designer and you know, planners, engineers. And so planners, yeah, work on transportation studies, you know, parking traffic stuff. 2 - We're three people and our main work is to be in. We're like the bridge between the city and the employers and property managers in Glendale.

ExperimentsInHonesty commented 2 years ago

@Jane4925 we met with the stakeholders on 2022-02-22

There was a question In 2021, were the majority of your projects in the permit process (check box): Commercial Residential Mixed-use Institutional Government Other

Suggest adding the following questions Have you ever worked on projects in any of the following categories? (Choose all that apply) [insert list of all project use cases]

pmeda12 commented 2 years ago

@Jane4925 we met with the stakeholders on 2022-02-22

There was a question In 2021, were the majority of your projects in the permit process (check box): Commercial Residential Mixed-use Institutional Government Other

Suggest adding the following questions Have you ever worked on projects in any of the following categories? (Choose all that apply) [insert list of all project use cases]

Consider this done.

Jane4925 commented 2 years ago

Reopen if necessary