iqasport / referee_hub

The hub for all internal data and management of that data in the IQA.
3 stars 4 forks source link

Admin insights into test performance #356

Open manio143 opened 1 year ago

manio143 commented 1 year ago

A major gap I'm currently seeing is the lack of data insights - not necessarily technical, but about performance of tests.

Something I'd look to implement is an API endpoint for admin users to be able to query the performance of their referees in an aggregated way.

  1. Tests taken over time, partitioned by pass/fail and certification type
  2. Distribution of point percentages achieved on tests
  3. Top 5 hardest questions in each certification type

All of those at a selectable period of time. The great thing is that we already have all this data in the database, just need to write a good query and implement a dashboard on the frontend.

Later on we can extend this to show more technical things like how many users logged-in in the last X days (based on last sign-in property), how many exports have been performed by admins, etc.

manio143 commented 4 months ago

Option for visualization https://observablehq.com/plot/getting-started

Also maybe show warning next to a question which is outside the standard deviation for pass rate.