Bruno-val-bus / student-helper

0 stars 0 forks source link

Testing MVP with reader Data #15

Open ernOho opened 3 months ago

ernOho commented 3 months ago

In the next two weeks, we will get reader data, where the reader is practicing for a play. This means, the reader will be reading his text repeatedly over the next 2 weeks. This will include spelling tests and comprehension tests via written (we can transcribe the written results and then run our evaluation to check how well it goes)

However, the research can also be done here is to see if our System can track the readers reading improvement progress over the two weeks (as he will be practicing the same passage again and again).

The goal is, to use this data to measure the readers performance via some of the metrics defined by @clanchief117 .

Therefore, we can evaluate the following:

To achieve any of the evaluations, the following steps need to be taken:

  1. Implement a Audio to text transcriber module (factory) via Whisper as a start.
  2. The transcription will entail time information, that can be used to measure the metrics which are presented in @clanchief117 powerpoint