ckoven / fates

repository for the Functionally Assembled Terrestrial Ecosystem Simulator (FATES)
Other
0 stars 0 forks source link

forward loop for same height sorting #3

Closed rgknox closed 5 years ago

rgknox commented 5 years ago

cool, testing it now, looks like things are working, will check back

rgknox commented 5 years ago

@ckoven , these changes passed the fates regression test. I also ran a 60 year f45 test using the 2 tropical clone parameter set, using the ranked exclusion mode. The two pfts are not b4b exactly the same, but I'm still in the process of determining how much different or similar they are. If you want, feel free to merge this, and we can go ahead and commit to master.

rgknox commented 5 years ago

Here is the comparison of the two tropical PFTS biomass after 60 years on the f45 grid: https://drive.google.com/file/d/1RnhBItuqArGeoWEyUpH4jL-JOzZ4AwX1/view?usp=sharing So this method does not do such a great job at preserving identicalness in the two... I think I will give your original method a try too. Sorry if this turned into more complication than its worth.

ckoven commented 5 years ago

i think its good at least that there isn't a consistent winner. so it does seem to just be generating numerical noise. i guess the important part is that it behaves better than what's on master -- could you run the exact same test with that?

rgknox commented 5 years ago

master is kinda weird, it is really consistent, but it has a bias: https://drive.google.com/file/d/144PRogHePpi9aeqnUllXTCIPJgBnfn8p/view?usp=sharing

rgknox commented 5 years ago

actually, it was just the color axis made it look like a bias. master, using non-ranked, gives almost exactly the same biomass from 1 pft to the other. See the last figure here: https://drive.google.com/open?id=144PRogHePpi9aeqnUllXTCIPJgBnfn8p

ckoven commented 5 years ago

that is really weird. lets chat when I'm back in town so that I can try to understand how this is the case. thanks for running the simulation.

rgknox commented 5 years ago

I updated the plots, included master, the base changes you proposed, and then my changes. Both of our versions aren't quite as good as the non-ranked master version at maintaining the parity of clones.

master (excln =3) : https://drive.google.com/file/d/1tPu1Z_ECrDLow6DhlDd5_c7UlykZexQW/view?usp=sharing

charlies PR version (excln = -1) : https://drive.google.com/file/d/1PYEv98qUgva6b9Uqw8QTnrYMx5rmbrIO/view?usp=sharing

ryan's "updates" (excln = -1) : https://drive.google.com/file/d/1veQuwBTnii0f5d8oENADPLEdkd72f2Oc/view?usp=sharing

excln = 3, but with new height based sorting: https://drive.google.com/file/d/1t_J6n5d-0N8wMCblkwCc06M8Y5n3ikXQ/view?usp=sharing

rgknox commented 5 years ago

I'm wondering if this has more to do with height sorting instead of dbh sorting... I'm now running a test to see if the probabalistic exclusion using height based sorting preserves clones as well as master was.

ckoven commented 5 years ago

Could you do a master (excln =-1) run? That is the minimum bar we need to exceed here.

ckoven commented 5 years ago

ps your version actually look pretty good!

rgknox commented 5 years ago

I posted a new version, it is excln = 3, with height based sorting. With height based sorting, there are now grid-cells that show divergence between the two clones that were not shown in the dbh sorting version. However, the differences are still much smaller than what we see in the two ranked promotion/demotion tests.

Although, I think it partially explains why we found that ranked prom/demo was not quite as good as the probabalistic prom/demo WRT preserving clones, what was really at play was that its harder to do when we are using heights instead of DBH.

master with excln = -1, I could run it through tests, but I think it just isn't coded to preserve clone similarity at all, there is no doubt there will be divergence. Although, I guess it would give us a sense of what the baseline is.

ckoven commented 5 years ago

ok, cool. no need to do the master/-1 case. agreed that that was only meant to be a minimal point. looks to me like your changes are a lot better than what I had, so I'm happy to pull this if you feel its ready. then, separately, we should figure out why height sorting isn't giving identical cohorts, since in principle it still should.

rgknox commented 5 years ago

great. If you merge this in, I will begin integration with master.