Closed swwalker closed 3 years ago
Decent web reference for these metrics and more: https://savvyapps.com/blog/mobile-app-analytics
This is related to feature: Create an Admin area for Kits where all admin features live - https://github.com/DukeLearningInnovation/kits/issues/440
Related to issue: Kits Analytics: build foundation for user and app event or activity tracking- https://github.com/DukeLearningInnovation/kits/issues/441
For reference: Here is what the stats page in Toolkits looks like now - https://duke.box.com/s/fc5g98ii6q84mikftlxql6nruqusmcyu
We still want all of this data and to be able to see it at a high level like this, but what would better to to be able to drill down on any of the numbers listed as a filter to see all the kits that fall into a specific data point. We'll want to look for trends on what disciplines/departments are using certain tools, and better understand how people are using user-created kits.
We might consider having app store analytics as just part of the overall admin analytics tool.
Information on dashboards curated by my colleague Kim Manturuk - https://duke.box.com/s/5uug16q3d2x3zwgzd52moxsfid8n1iau
Feature planning: Important questions we should answer before beginning to build this feature (see link below for more detail).
https://www.betterevaluation.org/en/evaluation-options/data_dashboard
Idea for MVP for this: A page that prompts for a date range and has a 'run report' button that runs a query for data in that date range. The report would be a downloaded .csv file. The query would include:
Creator Duke ID | Creator name | Course ID | Course Name | Course Type | Create date | Resource | Resource Display Name | Resource ID (url for custom link, siteid for Sakai site, etc).
This row would repeat for every resource associated with the kit. This format would make it easy to use pivot tables and Tableau to analyze the data.
Update: Perhaps just make this a job that runs at specific intervals emailing this data to those who need it. I had a conversation recently with Matt Royal about this. He would like to have this report weekly with Box IDs included. Who else will need this report? Are there other identifiers needed in tools that we can include (Sakai site id, etc)?
Would we need a page that simply shows the Jobs and allows you to add new ones/modify exisitng?
Updates on requirements for this feature per conversation with Matt R and the Kits Team on 5/4:
The goal is to provide a comprehensive report for all relevant Kits data and to get this data into Tableau. Service Owners for all integrated apps would have access to this and create the views they need for reporting.
Questions: Can we embed a Tableau dashboard into the Reporting feature in Kits? Should we still add an option to run a report for certain dates with an option to download the data? Or will those options be possible through Tableau?
Anything you'd like to add to this @ewendland23 ?
Notes from meeting with Susan Starnes today:
Next meeting will be a few weeks out. Jolie will organize.
@noahhh Here is the Figma mockup for the Kits Analytics page. Jen has an icon for this on the #440 Admin area frame in the same design file - https://www.figma.com/file/vbjsQkApG7rNknJUwv73xG/Admin-Console?node-id=0%3A2265 . Right next to the mockup is the embed code and button link text.
@joliet this is out in test, but the icon is not showing up for some reason. Will have to fix that when I am back from vacation.
This looks good @noahhh . My only feedback is to edit the button text to read 'Open in Tableau'.
Looks great. Thanks @noahhh ! This feature is ready for production.
@joliet this is in production
How might we (the Kits project team) show system admins useful information about how the system is being used by users?
Questions Possible integrated app metrics
Assumptions
Hypotheses
Related Problem Statements
203 #146