sourcecred / cred

https://cred.sourcecred.io/
11 stars 15 forks source link

Inquiry into raising our recent policy decay #281

Open blueridger opened 3 years ago

blueridger commented 3 years ago

I tried seeing what it would look like if we increase the recent policy decay to make it so newcomers can have faster access to income. The results aren't fully what I had imagined:

0.16 decay (current)

RECENT Policy
Budget 20,000.000g
Discount: 0.16
|          name          |    total    |     %     |
| ---------------------- | ----------- | --------- |
|         Thena          |  3,099.695  |  15.50%   |
|       topocount        |  1,718.702  |   8.59%   |
|      panchomiguel      |  1,532.238  |   7.66%   |
|          Jojo          |  1,490.876  |   7.45%   |
|       echojuliet       |  1,266.617  |   6.33%   |
|         s-ben          |  1,227.322  |   6.14%   |
|        KuraFire        |  1,169.732  |   5.85%   |
|      joiecousins       |   897.328   |   4.49%   |
|      decentralion      |   873.867   |   4.37%   |
|       lbstrobbe        |   781.048   |   3.91%   |
|      saintmedusa       |   618.685   |   3.09%   |
|        magwalk         |   480.455   |   2.40%   |
|     BrianBelhumeur     |   473.795   |   2.37%   |
|         hammad         |   462.284   |   2.31%   |
|       AL0YSI0US        |   319.721   |   1.60%   |
|       sandpiper        |   298.010   |   1.49%   |
|      scrabbleboy       |   289.132   |   1.45%   |
|         Marcie         |   283.851   |   1.42%   |
|          bex           |   283.263   |   1.42%   |
|      finitechris       |   276.189   |   1.38%   |
|        wchargin        |   259.270   |   1.30%   |
|         Willow         |   215.201   |   1.08%   |
|          Zizi          |   199.263   |   1.00%   |
|         Kokomo         |   151.102   |   0.76%   |
|        DeepWork        |   135.459   |   0.68%   |
|          eeli          |   119.390   |   0.60%   |
|       lotusleaf        |   110.791   |   0.55%   |
|          tua           |   110.755   |   0.55%   |
|         Felix          |   96.933    |   0.48%   |
|         fried          |   89.817    |   0.45%   |
|         Threm          |   80.457    |   0.40%   |
|    youngkidwarrior     |   69.794    |   0.35%   |
|        benoxmo         |   66.279    |   0.33%   |
|        prose11         |   60.451    |   0.30%   |
|       EbonyBelle       |   56.927    |   0.28%   |
|      TheCryptoCPA      |   39.628    |   0.20%   |
|          peth          |   38.527    |   0.19%   |
|      coopahtroopa      |   30.424    |   0.15%   |
|         beanow         |   28.337    |   0.14%   |
|         crisog         |   28.154    |   0.14%   |
|        Kilgore         |   25.384    |   0.13%   |
|         yalor          |   25.288    |   0.13%   |
|         amico          |   20.477    |   0.10%   |
|          evan          |   19.219    |   0.10%   |
|       Decryptify       |   15.306    |   0.08%   |
|        cortanav        |   11.073    |   0.06%   |
|          ...          |   ...   |   ...   |

0.6 decay (arbitrary higher number)

RECENT Policy
Budget 20,000.000g
Discount: 0.6
|          name          |    total    |     %     |
| ---------------------- | ----------- | --------- |
|         Thena          |  3,628.677  |  18.14%   |
|          Jojo          |  1,822.349  |   9.11%   |
|       topocount        |  1,665.302  |   8.33%   |
|      joiecousins       |  1,371.980  |   6.86%   |
|         s-ben          |  1,347.346  |   6.74%   |
|       echojuliet       |  1,345.474  |   6.73%   |
|      panchomiguel      |  1,085.738  |   5.43%   |
|        KuraFire        |  1,010.991  |   5.05%   |
|      saintmedusa       |   787.676   |   3.94%   |
|      scrabbleboy       |   712.503   |   3.56%   |
|       AL0YSI0US        |   675.102   |   3.38%   |
|      decentralion      |   632.174   |   3.16%   |
|         Marcie         |   512.594   |   2.56%   |
|        magwalk         |   466.970   |   2.33%   |
|      finitechris       |   461.450   |   2.31%   |
|       lbstrobbe        |   449.120   |   2.25%   |
|         Willow         |   357.072   |   1.79%   |
|     BrianBelhumeur     |   284.847   |   1.42%   |
|         Kokomo         |   192.870   |   0.96%   |
|         fried          |   173.654   |   0.87%   |
|          bex           |   171.655   |   0.86%   |
|          Zizi          |   151.657   |   0.76%   |
|       sandpiper        |   146.805   |   0.73%   |
|        prose11         |   134.165   |   0.67%   |
|       lotusleaf        |   85.968    |   0.43%   |
|         hammad         |   84.466    |   0.42%   |
|        wchargin        |   52.502    |   0.26%   |
|          tua           |   51.305    |   0.26%   |
|         Threm          |   45.162    |   0.23%   |
|         yalor          |   26.039    |   0.13%   |
|    youngkidwarrior     |   14.443    |   0.07%   |
|          eeli          |   12.750    |   0.06%   |
|        Kilgore         |   12.590    |   0.06%   |
|        benoxmo         |   10.373    |   0.05%   |
|          ...          |   ...   |   ...   |
blueridger commented 3 years ago

A better tool for comparison: https://observablehq.com/@sourcecred/grain-config-simulator

topocount commented 3 years ago

This looks like what i was expecting, honestly. Newer folks who have been spending more time in SC are seeing ~2x what they've otherwise been receiving

s-ben commented 3 years ago

One thing to note is that 0.6 still catches a decent amount of contributions from up to 3 weeks back. Here's a chart showing the curves for the 0.16 and 0.6 decay.

image

There is also some amount of 'smearing' if I understand correctly between epochs. In Timeline Cred, Cred minted on a contibution would take 3-4 weeks to exponentially decay to negligible amounts. If in CredRank, Cred minted 'smears' have a similar effect, then a non-negligible amount of Cred earned in the last week will be leaking into previous weeks?

Yet another complicating factor could be variability in Cred inflation? Below is a chart showing total Cred created per week, calculated from data from the Cred and Grain CSV Downloader. It seems the Cred inflation has been pretty stable the last few weeks (not counting April 10 partial week, which I'm assuming Grain is not distributed for). However, since you're distributing a flat amount of Grain, presumably you'd need to normalize contributors' Cred earned to more accurately compare contributors' % Cred earned per week.

image

If we're achieving the main objective (boost newer contributors' pay), then it seems this is achieving that. If we want to have a better understanding of what's happening with the scores, perhaps we could try a more extreme case that should be easily predictable? Set decay to 1 (equivalent to Immediate policy) and see if it corresponds to expectations?

KuraFire commented 3 years ago

I am curious as to how important it is for us to make such pretty significant changes to our foundations in order to, what, placate new people and make them see more instant gratification? What is the value-add for us there?

Note that "incentivizing new people" also means potentially incentivizing gaming with newly created accounts.

blueridger commented 3 years ago

pretty significant changes to our foundations

Not sure what you mean by this. This thread is exploring a 1 line config change, not a code change.

The value add is fairer compensation for newer contributors. Working 2+ months before achieving payout equity can seem pretty extreme. It also incentivizes old contributors to stay active, though with the downside of sharper pay cuts if you take a week or two off.

I'm not particularly concerned about gaming right now, since our platforms are pretty well moderated and there are several manual, reversible checkpoints between cred-flowing activity and money leaving our treasury. I definitely wouldn't want to miss out on opportunities to improve pay equity and help the newcomers we do want to fold in, just on account of the always-present dice roll of whether gamers are going to try and get past our many-layered moderation.

I haven't come to a strong opinion either way.