search

stacks-archive / app-mining

For App Mining landing page development and App Mining operations.
https://app.co/mining
MIT License
48 stars 16 forks source link

Proposal: TryMyUI review period #114

Open stackatron opened 5 years ago

stackatron commented 5 years ago

What is the problem you are seeing? Please describe. Occasionally bugs in the Blockstack browser will block a user from successfully logging in to an app, or cause friction for that user. That user may give the app a decreased score on TryMyUI.

How is this problem misaligned with goals of app mining? Apps may have lower scores than they should otherwise.

What is the explicit recommendation you’re looking to propose? We already have a review and audit period for the scores/ranking. Can we extend this review period to the videos? And app developers can flag issues if they spot any?

Describe your long term considerations in proposing this change. Please include the ways you can predict this recommendation could go wrong and possible ways mitigate. One clear issue: Apps can spuriously claim a bug when in-fact they just have low scores. Or they might claim a bug and then it takes days of investigation to track down exactly what happened. This will lead to delays in the overall App Mining payout timeline.

Additional context I'm suggesting this change at the request of @jehunter5811

stackatron commented 5 years ago

@trotolo can you please share thoughts?

stackatron commented 5 years ago

Assigning @hstove simply because you ultimately kick off review period.

stackatron commented 5 years ago

Sounds like next step here is a chat with Tim.

sdeepak23 commented 5 years ago

It will also be helpful to have some documentation around how trymyui scores are processed from raw scores. Right now it is just mentioned that highest and lowest are excluded to help with the variance.