search

LearnersGuild / learning-os

The Learning Operating System of Learners Guild. Our applied game and player support.
0 stars 1 forks source link

Define RSG stats #235

Open tannerwelsh opened 8 years ago

tannerwelsh commented 8 years ago

Context

We need player stats around RSGs. Stat. (get it? stat = ASAP)

Criteria

In order for an issue to be marked as passing, the proposed solution must be aligned with our principles. Check off the principles that this solution is consistent with.

tannerwelsh commented 8 years ago

Some notes from conversation between @awolfinthewind and myself: https://docs.google.com/document/d/1maj-CQDGpOnOdjT0CzdckKy9lkGVqRPaFIM6-WA47wk/edit

tannerwelsh commented 8 years ago

This impacts #217

shereefb commented 8 years ago

related #221

tannerwelsh commented 8 years ago

Doing work in this branch: https://github.com/LearnersGuild/learning-os/tree/tw/rsg-stats

tannerwelsh commented 8 years ago

@awolfinthewind would love your thoughts on the stats I've come up with so far here: https://github.com/LearnersGuild/learning-os/blob/tw/rsg-stats/game/stats.md

Tried to keep things simple at the start. Are these useful for your RSG module? Are they enough?

tannerwelsh commented 8 years ago

Added a few changes to #268

tannerwelsh commented 8 years ago

Ok need some help thinking about the relevancy. It seems more complicated that stretchiness.

The "stretchiness" stats can be captured during the retrospective by having learners reflect on how much time they spent in their PZD.

I'm tempted to tie the relevancy score to a goal and to let all learners vote on how relevant it is to their chosen craft.

So for example, if we have a goal that is "Build a CRUD web app using a relational database", then learners can assign relevancy values (1-5) for a set of "crafts" that the goal could cover, e.g.:

As more and more learners evaluate the relevancy of goals for particular crafts, we can do some interesting things to determine the intelligence of these measurements, e.g.:

awolfinthewind commented 8 years ago

That could work. I still think it's going to be really hard for the Learners to estimate relevancy. Aren't there some checks we could put in where the practitioner sets the bar? Then we could see the learners improve against the practitioner's measure over time, another indicator that they are transforming.

On Thu, Apr 14, 2016 at 7:22 PM Tanner Welsh notifications@github.com wrote:

Ok need some help thinking about the relevancy. It seems more complicated that stretchiness.

The "stretchiness" stats can be captured during the retrospective by having learners reflect on how much time they spent in their PZD.

I'm tempted to tie the relevancy score to a goal and to let all learners vote on how relevant it is to their chosen craft.

So for example, if we have a goal that is "Build a CRUD web app using a relational database", then learners can assign relevancy values (1-5) for a set of "crafts" that the goal could cover, e.g.:

  • Full-stack web developer: 5
  • Front-end web developer: 4
  • Back-end web developer: 4
  • Mobile developer: 1
  • DevOps: 2

As more and more learners evaluate the relevancy of goals for particular crafts, we can do some interesting things to determine the intelligence of these measurements, e.g.:

  • Find average relevancy score
  • Find relevancy score given by the learners with highest ECC
  • Find relevancy score given by practitioners only

— You are receiving this because you were mentioned. Reply to this email directly or view it on GitHub https://github.com/LearnersGuild/learning-os/issues/235#issuecomment-210033093

tannerwelsh commented 8 years ago

@awolfinthewind: since the practitioners will have tons more experience than other learners, their relevancy rankings can be weighted much more heavily. So we could calculate overall relevancy scores using a formula of something like:

sum(estimates of each learner * ECC of learner) / sum(ECC of all learners who submitted estimates)

(ECC is "Effective Contribution Cycles", our measure of experience)

so if there are two estimates:

then the total relevancy would be 

((4 * 3) + (2 * 8)) / (3 + 8) = 2.54

Are you around next week? I'd love to revisit this conversation with you.

awolfinthewind commented 8 years ago

Sounds good. I'm available to zoom on this next week. I'm currently Eastern +5 hours.

On Fri, Apr 15, 2016 at 7:33 PM Tanner Welsh notifications@github.com wrote:

@awolfinthewind https://github.com/awolfinthewind: since the practitioners will have tons more experience than other learners, their relevancy rankings can be weighted much more heavily. So we could calculate overall relevancy scores using a formula of something like:

sum(estimates of each learner * ECC of learner) / sum(ECC of all learners who submitted estimates)

(ECC is "Effective Contribution Cycles", our measure of experience)

so if there are two estimates:

  • Learner A (3 ECC) estimates a relevancy of 4
  • Learner B (8 ECC) estimates a relevancy of 2

then the total relevancy would be

((4 * 3) + (2 * 8)) / (3 + 8) = 2.54

Are you around next week? I'd love to revisit this conversation with you.

— You are receiving this because you were mentioned. Reply to this email directly or view it on GitHub https://github.com/LearnersGuild/learning-os/issues/235#issuecomment-210533190