search

UIUC-Chatbot / ai-ta-backend

API backend for UIUC AI Teaching Assistant.
https://docs.uiuc.chat/
9 stars 4 forks source link

Dashboard for User & Project Metrics #286

Open KastanDay opened 2 months ago

KastanDay commented 2 months ago
  1. North start metric: documents per project (or even tokens per project).
  2. North start metric: conversations per project.
  3. Total number of projects (over time)
  4. ⭐️ Number of unique users per project.
  5. ⭐️ Number of projects per user.
  6. Also add the cumlative.
  7. ⭐️ Per project, number of days since last interaction?
  8. Avg session duration, or number of chat messages per session?
  9. Pageview per user.
  10. Per user, number of projects interacted with.Stretch goal:* What was the last user interaction (or screen recording) before they dropoff for >30 days?
KastanDay commented 2 weeks ago

New metric: Admins vs non-admins.

Average number of "turns" per conversation. Example 4 turn conversation:

  1. User: "What is this HW?"
  2. Bot: "It's this... xyz."
  3. User: "No I meant this"
  4. Bot: "Oh ok it's this".
96feilin96 commented 1 day ago

New Metrics:

  1. Active admin vs active users

  2. Bounce rate = (Single-page visits / Total visits) × 100%

  3. Cumulative graphs for everything

  4. Accuracy of response, user satisfaction --- add satisfaction

  5. Admin side of uiuc chat – ask for access

  6. Usage patterns= what are the peak hours or peak times

  7. Customer segmentation 2- admins and users

  8. Market the product ? survey of professors/ student who already use it

KastanDay commented 20 hours ago

⭐️ == WORK FOR YOU ALL 👉 == WORK FOR KASTAN

⭐️ Per project, number of days since last interaction? ⭐️ Per user email, number of days since last interaction?

❓ Active user - track every time a user logs in to a specific course/project. e.g. Find users who viewed course within 7 days.

✅ bounce rate - session duration after going directly to a page...

👉 /chat feedback from user - thumbs up / report problem

👉 Track number of new projects created -

✅ Number of unique users per project. - unique user who has pageview on pagename... 👉 Number of projects per user.

👉 Track admin added to project 👉 Track admin removed from project