Proposal: Create standard methodology in the event that an app cannot be reviewed by a reviewer

stacks-archive / app-mining

For App Mining landing page development and App Mining operations.

https://app.co/mining

MIT License

48 stars 16 forks source link

Proposal: Create standard methodology in the event that an app cannot be reviewed by a reviewer #51

Closed GinaAbrams closed 5 years ago

GinaAbrams commented 5 years ago

Currently, there are some apps that do not qualify to be tested in certain circumstances. E.g. they may need to use another app to be useful, or they may require a certain hardware that is not accessible to everyone. As time goes on and reviewers are added, this will become more and more of an issue.

Open question:

How can we create a method that is fair to the community, while not punishing the app founders when this happens?

Next steps:

Determine said process, add to FAQ.

friedger commented 5 years ago

The current method is that it gets a theta score of -1 (with the idea that -1 is not the worst).

stackatron commented 5 years ago

Sounds like this is related to https://github.com/blockstack/app-mining/issues/35 and is already resolved, closing.

friedger commented 5 years ago

I would like to re-open this issue because with the dry run in April shows that it is possible that a half reviewed app can become first place.

kar2905 commented 5 years ago

I'd like to second on the reopening of this issue. I think we should discuss a better methodology when an app cannot be reviewed by certain reviewers. Maybe it gets the average of all the others app in the category?

friedger commented 5 years ago

I see that there is a discussion about this on #91