asherliu / researchHOWTO

Slides about how to do research
65 stars 15 forks source link

define the metric of success #2

Open chunhualiao opened 5 years ago

chunhualiao commented 5 years ago

How to evaluate if this tutorial is effective ? Should you have some (incremental) tests to check if readers grasp the key concepts and skills ? Or a reader shows he/she publishes a paper (judging by end results)?

chunhualiao commented 5 years ago

I just found this:

https://en.m.wikipedia.org/wiki/Donald_Kirkpatrick

The four levels of Kirkpatrick's evaluation model are as follows:

Reaction - what participants thought and felt about the training (satisfaction; "smile sheets")

Learning - the resulting increase in knowledge and/or skills, and change in attitudes. This evaluation occurs during the training in the form of either a knowledge demonstration or test.

Behavior - transfer of knowledge, skills, and/or attitudes from classroom to the job (change in job behavior due to training program). This evaluation occurs 3–6 months post training while the trainee is performing the job. Evaluation usually occurs through observation.

Results - the final results that occurred because of attendance and participation in a training program (can be monetary, performance-based, etc.)

hpda-lab commented 5 years ago

When it goes to writing a paper, Think Like A Reader is the most important trick! Two ways to create such a "reader".

In short, the evaluation of success often comes from outsider instead of yourself.

Probably, the end goal is to put together a tool. Once you feed in the paper, this tool can help you judge the extent of progresses.