Closed rgknox closed 5 years ago
@ckoven , these changes passed the fates regression test. I also ran a 60 year f45 test using the 2 tropical clone parameter set, using the ranked exclusion mode. The two pfts are not b4b exactly the same, but I'm still in the process of determining how much different or similar they are. If you want, feel free to merge this, and we can go ahead and commit to master.
Here is the comparison of the two tropical PFTS biomass after 60 years on the f45 grid: https://drive.google.com/file/d/1RnhBItuqArGeoWEyUpH4jL-JOzZ4AwX1/view?usp=sharing So this method does not do such a great job at preserving identicalness in the two... I think I will give your original method a try too. Sorry if this turned into more complication than its worth.
i think its good at least that there isn't a consistent winner. so it does seem to just be generating numerical noise. i guess the important part is that it behaves better than what's on master -- could you run the exact same test with that?
master is kinda weird, it is really consistent, but it has a bias: https://drive.google.com/file/d/144PRogHePpi9aeqnUllXTCIPJgBnfn8p/view?usp=sharing
actually, it was just the color axis made it look like a bias. master, using non-ranked, gives almost exactly the same biomass from 1 pft to the other. See the last figure here: https://drive.google.com/open?id=144PRogHePpi9aeqnUllXTCIPJgBnfn8p
that is really weird. lets chat when I'm back in town so that I can try to understand how this is the case. thanks for running the simulation.
I updated the plots, included master, the base changes you proposed, and then my changes. Both of our versions aren't quite as good as the non-ranked master version at maintaining the parity of clones.
master (excln =3) : https://drive.google.com/file/d/1tPu1Z_ECrDLow6DhlDd5_c7UlykZexQW/view?usp=sharing
charlies PR version (excln = -1) : https://drive.google.com/file/d/1PYEv98qUgva6b9Uqw8QTnrYMx5rmbrIO/view?usp=sharing
ryan's "updates" (excln = -1) : https://drive.google.com/file/d/1veQuwBTnii0f5d8oENADPLEdkd72f2Oc/view?usp=sharing
excln = 3, but with new height based sorting: https://drive.google.com/file/d/1t_J6n5d-0N8wMCblkwCc06M8Y5n3ikXQ/view?usp=sharing
I'm wondering if this has more to do with height sorting instead of dbh sorting... I'm now running a test to see if the probabalistic exclusion using height based sorting preserves clones as well as master was.
Could you do a master (excln =-1) run? That is the minimum bar we need to exceed here.
ps your version actually look pretty good!
I posted a new version, it is excln = 3, with height based sorting. With height based sorting, there are now grid-cells that show divergence between the two clones that were not shown in the dbh sorting version. However, the differences are still much smaller than what we see in the two ranked promotion/demotion tests.
Although, I think it partially explains why we found that ranked prom/demo was not quite as good as the probabalistic prom/demo WRT preserving clones, what was really at play was that its harder to do when we are using heights instead of DBH.
master with excln = -1, I could run it through tests, but I think it just isn't coded to preserve clone similarity at all, there is no doubt there will be divergence. Although, I guess it would give us a sense of what the baseline is.
ok, cool. no need to do the master/-1 case. agreed that that was only meant to be a minimal point. looks to me like your changes are a lot better than what I had, so I'm happy to pull this if you feel its ready. then, separately, we should figure out why height sorting isn't giving identical cohorts, since in principle it still should.
great. If you merge this in, I will begin integration with master.
cool, testing it now, looks like things are working, will check back