search

seer-lab / RoboGames

A game for learning programming through understanding and comprehension of source code.
http://www.sqrlab.ca/software/roboton/
Mozilla Public License 2.0
9 stars 5 forks source link

Fix logging errors and format #246

Open bradbury opened 3 years ago

bradbury commented 3 years ago

There are some discrepancies with the time data in the game log. There are also some errors in logging including empty data reported. Regarding format, we need to revise to make it easier to parse.

MichaelMiljanovic commented 3 years ago

Logging needs to be modified to better support the following aspects of data collection:

  1. Average seconds taken per level (per cohort & per student)
  2. Total failures per level (per cohort & per student)
  3. % of students who complete a given level
  4. % of students who fail a level at least once
  5. Mode of gameplay (Non-adaptive, adaptive gameplay, adaptive hints)
  6. (Average) Idle time (per cohort & per student)
MichaelMiljanovic commented 3 years ago

Things to log: competence (per level, vector of values) cause of failure (obstacle, misuse of bugcatcher) / counting each event move mode (adaptive (hints/gameplay) /nonadaptive) to higher level logging levels completed / debug mode setting / picking levels