ProjectSidewalk / sidewalk-data-analysis

Holds all offline data analysis scripts for Project Sidewalk required for our forthcoming paper submission
3 stars 0 forks source link

See if users stop auditing after finishing a mission #5

Open misaugstad opened 6 years ago

misaugstad commented 6 years ago

This will give us an idea of how well our rudimentary gamification of the mission works. How to analyze this is not immediately obvious to me. The best I have come up with so far is to take a look at the end time for each auditing session, and look at how far this end time is from the start time of their current mission. So this would give us how long users audit after completing a mission on average. If it helps, we can translate this into distance using the average auditing speed for a user (but getting actual distance audited after a mission is more tricky).

@jonfroehlich @manaswis How does that method of analysis sound? Any other suggestions?

manaswisaha commented 6 years ago

I like the idea: amount of time spent auditing since the start of the current mission. To do this, we should take each session, and then calculate the time spent auditing post 1 mission completion.

misaugstad commented 6 years ago

@manaswis Wait... I don't think you mean just after the first mission. Could you just check this and clarify what you meant?

manaswisaha commented 6 years ago

I meant, in each session, calculate the time after completing the first mission in that session (not their very first mission).

misaugstad commented 6 years ago

Hmm okay I think we are talking about different things then. I am talking about measuring whether or not users treat the completion of a mission as the time to stop auditing (be it their first mission, second, third, etc. of their current session). Say they have already done 4 missions and are halfway through their 5th, and they sort of feel like stopping; do they stop right there in the middle of the mission, or do they push through just to finish the mission they are on before stopping?

And to measure that, I am talking about looking at the time auditing since the start of their current mission, not the end of the the first mission in that session.

manaswisaha commented 6 years ago

Okay. I like yours better. Let's go with that.