Add more review dimensions to NIL reviewer

[stackatron]

Hank analyzed increasing weight of NIL and he determined it would have negligible effect. This is because most apps meet the simple and binary requirements. I'm curious what other factors or dimensions could be measured by NIL that would lead to more positive competition and variance in scores? @larrysalibra ?

[ViniciusBP]

I'm not sure if it's easy to find a scalable solution, but it would be great to have some dimension related to the necessity of using Blockstack to perform the most important app action.

Some products are using it as "optional backup/sync" and they benefit from better TryMyUi scores because it's much easier to use it, since the testers don't need to register. Those products are not really using Blockstack imo.

[ViniciusBP]

I don't have access to other apps TryMyUI videos, but just to give an example, I would say there is a big chance most testers didn't use the Sync option of the Dadroit Viewer. Can someone check if this is the case? I don't think it is fair that those products using Blockstack as an optional secondary feature get all points related to NIL. Probably a little bit less but the same for Benten Sound, since it is possible to download and play sounds without logging in. You only need to login if you want to favorite it.

Those are Top 2 and 4 of the current month, and I'm not sure this is the kind of integration expected from Apps, if it is, we should be aware this is the case.

[friedger]

possible dimension:

• works offline
• is open source
• use of collections
• the number of blockstack apps that also uses the same collection schema

@ViniciusBP I would expect apps to work offline, therefore the storage is usually only a sync feature. I'd argue that not forcing users to login is a good thing for apps that respects users' rights.

[dmailonline]

possible dimension:

• Utilizing Radiks as a Blockstack Framework for developers.
• User increasing acceleration according to theblockstats.com.

We believe that the highest weight of the scoring system should come from NIL because of focusing on building not only Apps but high-quality Apps that utilize the Blockstack Technology in the best way.

[muneebm]

I don't know how scalable this is going to be, but analyzing the network calls the app is making while performing the basic features could be one dimension to make sure the app is not violating data ownership or user privacy. From NIL founder himself :)

A few more:

1. Whether or not the product solves a true problem
2. The uniqueness of the solution
3. Quality of their execution

[stackatron]

@larrysalibra can you please chime in here. Overall the community really values the NIL reviewer and wants you to add more dimensions. If would be great to have a roadmap or ranked list of possible dimensions and your immediate and future plans. Thx.

[larrysalibra]

I don't know how scalable this is going to be, but analyzing the network calls the app is making while performing the basic features could be one dimension to make sure the app is not violating data ownership or user privacy.

Exactly @muneebm!

As I mentioned in last month's App Mining call - the next dimension I'm focused on is the use of third party resources in apps. I did some analysis on August's cohort and will be sharing the results and a way forward in the next few days! Stay tuned!

---

There are a lot of other great suggestions here:

I don't think it is fair that those products using Blockstack as an optional secondary feature get all points related to NIL.

I agree that this doesn't seem that fair - do you have any suggestions about how we can address this @ViniciusBP ?

Utilizing Radiks as a Blockstack Framework for developers.

I wouldn't want to reward an app for using it that didn't need it.

I would expect apps to work offline, therefore the storage is usually only a sync feature. I'd argue that not forcing users to login is a good thing for apps that respects users' rights.

@friedger As someone who spends a lot of time on planes, I agree that apps should work offline. This could be a very interesting metric - apps could write to local storage and only sync to gaia when the user comes online. Do any apps in app mining do this now?

the number of blockstack apps that also uses the same collection schema

I like this idea! Are any apps using collections as of now?

[Walterion01]

@larrysalibra Thanks for the input. Do you have a suggestion about apps that are not dependent on any server at all? Wholy decentralised and just reliant on Gaia. This way, we can promote and push the limits to be decentralised and not only encrypted.

@friedger As someone who spends a lot of time on planes, I agree that apps should work offline. This could be a very interesting metric - apps could write to local storage and only sync to gaia when the user comes online. Do any apps in app mining do this now?

Yes, Dadroit apps are doing this and will improve this behaviour. They will store settings, history, and credentials info in Gaia on user choice so it can be synced and collaborate with teammates soon. As a developer don't like an online development tool or any tool that need to sync some data before let me work on my ideas, like Google Android Studio.

[friedger]

Do any apps in app mining do this now?

OI Timesheet is working offline.

Are any apps using collections as of now?

Collections are still under development.

[ViniciusBP]

In order to work offline, apps will need to make Blockstack auth optional. It helps user experience because almost no one actually use it, but it hurts adoption, some top apps had less than 25 blockstack installs. So I don't think working offline should be a dimension used.

+1 for @friedger Open Source dimension suggestion, this is quite simple and powerful.

[stackatron]

Sounds like no specific changes for this cycle. I will review this and summarize. @larrysalibra will announce changes in the next couple months.

[dantrevino]

Can we get an update on this? Why is it closed? What specific dimensions are being added? Why can the public not get input on those?

Can this issue be re-opened?

[stackatron]

@larrysalibra is working on this. Believe he will announce the proposed new scoring measures today or tomorrow.

[larrysalibra]

We're going to propose some metrics from the Can't Be Evil Sandbox are added to App Mining. You can read about that here. Specific metrics proposals will be available soon.