Evaluation Score Calculation

[r-bartlett-gsa]

User story

As a challenge manager, in order to ensure accurate scoring of submissions, I want the evaluation form criteria scores to be calculated based on predefined criteria scoring options and provided as a single final score.

Acceptance criteria:

• [ ] When an evaluation form is in use by an evaluator, the selected or inputted scores are calculated for each individual criteria based on how the challenge manager predefined the scale type, criteria weights, points, and score options
• [ ] If the evaluation form uses weighted scale, the criteria score is calculated using the following formula:
  • [ ] Rating or Binary Scale:
  • [ ] ((worst case option - selected option)/ (worst case option - best case option)) * criteria points or weight/100
  • [ ] Numeric score:
  • [ ] ((0 - inputted score)/ (0 - criteria points)) * criteria points or weight/100
  • [ ] Note: criteria points and weight are the same value
  • [ ] For weighted scale, evaluation form score is calculated and is displayed throughout as a percentage
• [ ] If the evaluation form uses point scale, the criteria score is calculated using the following formula:
  • [ ] Rating or Binary Scale:
  • [ ] ((worst case option - selected option)/ (worst case option - best case option)) * criteria points or weight
  • [ ] Numeric score:
  • [ ] ((0 - inputted score)/ (0 - criteria points)) * criteria points or weight
  • [ ] For point scale, evaluation form score is calculated and is displayed throughout as a numerical score
• [ ] Calculated scores for point and for weighted scale are rounded to two decimal places
• [ ] The score for the evaluation form is calculated by adding up all criteria scores
• [ ] Scores are calculated and saved for each individual evaluator as they submit the evaluation forms for the submission they are assigned to
• [ ] The final score for the submission is an average of scores submitted by all the evaluators assigned to a submission

Development tasks:

• [ ] Task 1
• [ ] Task 2

Definition of Done

Doing (dev team)

• [ ] Code complete
• [ ] Code is organized appropriately
• [ ] Any known trade offs are documented in the associated GH issue
• [ ] Code is documented, modules, shared functions, etc.
• [ ] Automated testing has been added or updated in response to changes in this PR
• [ ] The feature is smoke tested to confirm it meets requirements
• [ ] Database changes have been peer reviewed for index changes and performance bottlenecks
• [ ] PR that changes or adds UI
  • [ ] include a screenshot of the WAVE report for the altered pages
  • [ ] Confirm changes were validated for mobile responsiveness
• [ ] PR approved / Peer reviewed
• [ ] Security scans passed
• [ ] Automate accessibility tests passed
• [ ] Build process and deployment is automated and repeatable
• [ ] Feature toggles if appropriate
• [ ] Deploy to staging

• [ ] Move card to testing column in the board

  Staging

• [ ] Usability testing: mobile and desktop (Tracy or Marni)
• [ ] Accessibility tested (Marni)
  • [ ] Keyboard navigation
  • [ ] Focus confirmed
  • [ ] Color contrast compliance
  • [ ] Screen reader testing
• [ ] Cross browser testing - UI rendering is performant on below listed devices/browsers (Tracy or Marni)
  • [ ] Windows/Chrome
  • [ ] Windows/Edge
  • [ ] Mac/Chrome
  • [ ] Mac/Safari
  • [ ] iOS/Safari
• [ ] AC review (Renata)
• [ ] Deploy to production (production-like environment for eval capability) (dev team)

• [ ] Move to production column in the board

  Production

• [ ] User and security documentation has been reviewed for necessary updates (Renata/Tracy/Dev team)
• [ ] PO / PM approved (Jarah or Renata)
• [ ] AC is met and it works as expected (Jarah or Renata)
• [ ] Move to done column in the board (Jarah or Renata)

[r-bartlett-gsa]

Scoring examples: https://docs.google.com/spreadsheets/d/18aeDcSBxEDFUMRHbLrc_RLqzB3h9m7i18NdmL2Qb-KM/edit?usp=sharing

[r-bartlett-gsa]

@cpreisinger There's a link to the spreadsheet in above comment, but just in case it was missed, our score calculation examples are here: https://docs.google.com/spreadsheets/d/18aeDcSBxEDFUMRHbLrc_RLqzB3h9m7i18NdmL2Qb-KM/edit?gid=653971161#gid=653971161 Please let me know if you have any questions.