ubc / compair

ComPAIR: a peer review application pairing student answers for deeper learning through comparison of peer work
http://ubc.github.io/compair
GNU General Public License v3.0
35 stars 11 forks source link

Break out self-evaluations as a separate step #687

Closed lenglund closed 6 years ago

lenglund commented 6 years ago

Right now, we treat self-evaluations as an "add-on" for comparisons. Instructors are interested in using this in a more robust way, in particular to encourage students to reflect on the feedback they receive. So having the option for self-evaluations to happen at a later stage in the overall process.

This requires:

Something else we might want to consider is having a checkbox for the instructor to explicitly select if the self-eval is to evaluate based on other answers or peer feedback. This could then dictate if we show/link to the student's completed comparisons or received feedback when they are on the self-eval screen.

wynnset commented 6 years ago

@lenglund / @andrew-gardener regarding the actual logic changes, I have a couple of questions:

  1. Currently, students can only do self-eval if they have completed all their comparisons. a. Do we want this logic to stay in place? Or should they still be able to self-eval even if they have not completed all their comparisons? b. How would this logic change if the comparison period has ended? c. How would this logic change in the case where there is no self-eval date range specified (but self-eval is enabled)? (Assuming fall back to existing logic in this case)
  2. What are the constraints on these dates? a. I'm assuming self-eval start date has to be after comparison start date. b. Could the self-eval start date be before the comparison end date? c. Could the self-eval end date be before the comparison end date?
  3. What's the logic if there is no self-eval end date defined? Can they self-eval until the course end date?

Thanks in advance

lenglund commented 6 years ago

I think we only update the logic if a self-eval start/end date has been added. Otherwise, we treat this as the final step in comparing (i.e., leave as-is).

So IF a self-eval date is added THEN: 1a) Self-eval can be available without finishing comparisons (as it is now a separate step and not the final step in comparing). 1b) Comparison period open or closed doesn't matter. 1c) Under this condition does not occur.

2a) The only constraint I suppose would be start date has to fall after the answer end date and end date has to fall before course end date (if one exists?). This means self-eval could come before, during, or after comparisons. What do you think @andrew-gardener? Am I overlooking complexities or other logic here? 2b) Yes. 2c) Yes.

3) How do we handle entering comparison start/end date? I think we require neither or both. Suggest the same approach here.

andrew-gardener commented 6 years ago

2a) The only constraint I suppose would be start date has to fall after the answer end date and end date has to fall before course end date (if one exists?). This means self-eval could come before, during, or after comparisons. What do you think @andrew-gardener? Am I overlooking complexities or other logic here?

This sounds fine to me

How do we handle entering comparison start/end date? I think we require neither or both. Suggest the same approach here.

We currently require neither or both for start/end date.

So that would mean that:

Currently students are automatically redirected to self-eval after comparisons completed. I think we'd still want this to happen.

I assume when there is a self-evaluation period we would not want to automatically redirect to self-eval after comparisons are completed at all (even if it could be completed afterwards).

wynnset commented 6 years ago

Perfect. Thanks to both of you for your input.