search

si2-urssi / plan

Implementation plan for the US Research Software Sustainability Institute
http://plan.urssi.us/
Creative Commons Zero v1.0 Universal
2 stars 4 forks source link

evaluation framework #78

Open danielskatz opened 4 years ago

danielskatz commented 4 years ago

We need an evaluation framework in chapter 10 that goes from actions to objectives to outcomes to impacts to high-level changes, and includes how this will be measured (metrics). The high-level changes probably also need to be in Chapter 3

danielskatz commented 4 years ago

or maybe the evaluation framework needs to be in Chapter 3? Maybe as a final subsection?

npch commented 4 years ago

I think you need to show how the evaluation framework will be used to assess high level "success" in Chapter 3. The full blown "how you evaluate" can be left to Chapter 10.

Currently, chapter 3 is mostly talking about approaches, and the impacts are only stated at the highest level based on the objects (software, people, ecosystem).

Could more specific outcomes and impacts be provided here, which can then be referenced in the individual metrics / milestones sections that follow, to show how each activity delivers the desired impacts?

npch commented 4 years ago

In Chapter 3, I think you're talking about both broad brush impacts, and also highlighted some specific examples.

For a long time in the UK, we were encouraged to think about impact along the following categories: