What is the viability & value of having a test mission for users through a pre-labeled street that can be considered a gold-standard (ex: Jon or Mikey's missions). This could be after the tutorial or several missions (allowing for users to get comfortable with the process). This would allow for us to have a more concrete accuracy evaluation of all users & would also allow us to analyze false negatives which we are not currently able to identify.
When I mentioned this to Jon in person he voiced the concern about how having users go through data that we already know would take away from them providing new data.
What is the viability & value of having a test mission for users through a pre-labeled street that can be considered a gold-standard (ex: Jon or Mikey's missions). This could be after the tutorial or several missions (allowing for users to get comfortable with the process). This would allow for us to have a more concrete accuracy evaluation of all users & would also allow us to analyze false negatives which we are not currently able to identify.
When I mentioned this to Jon in person he voiced the concern about how having users go through data that we already know would take away from them providing new data.