search

ProjectSidewalk / sidewalk-data-analysis

Holds all offline data analysis scripts for Project Sidewalk required for our forthcoming paper submission
3 stars 0 forks source link

Add another interaction event to queries that compute auditing time #9

Closed misaugstad closed 6 years ago

misaugstad commented 6 years ago

ProjectSidewalk/SidewalkWebpage#1244 text:

While doing analysis for the paper, we found one user that had a computed auditing time of 0 minutes because they had only one recorded ViewControl_MouseDown event (which is the only event we are using), even though they had placed 15 labels. No idea how this happened, and it is the only case we found, but we should add one more event just to be safe. So I will look through this user's events and pick a similar one that they do have, and I'll add it to the list of events we check for when computing auditing time.

The queries in the stats_for_paper script are copied (and slightly modified) from the ones in the main sidewalk repo. We are going to make the change to the auditing time queries in the main repo (ProjectSidewalk/SidewalkWebpage#1244), and should make the same changes here.

misaugstad commented 6 years ago

The new event I am adding is LabelingCanvas_MouseDown, which occurs when a user places a label. This isn't perfect, but the case we are trying to fix here is a rare edge case that I have only seen in the data before we added the more comprehensive logging, so there are not many options for fixing the issue.

In the edge case I looked at (which is the only such case I could find), this did fix the problem appropriately while having almost no effect on the rest of the data.

And again, this isn't a big issue and I think this fix is appropriate for now :) When we deploy to new cities, we will have the comprehensive logging from the beginning, so we will have more flexibility here!