ClimateImpactLab / dodola

Containerized application for running individual tasks in a larger, orchestrated CMIP6 bias-adjustment and downscaling workflow.
https://climateimpactlab.github.io/dodola/
Apache License 2.0
16 stars 8 forks source link

floor and ceiling for DTR #163

Closed emileten closed 2 years ago

emileten commented 2 years ago

This means our DTR 'validation' looses its meaning from when the DTR correction is applied on. It's a quick-and-dirty fix.

@dgergel this is just applying a cap at 70. This follows what I saw in the data (data points away from 60th north parallel but with a value significantly larger than 70) and me realizing (1) that 60th north parallel already crosses a significant european population area and (2) 70 diff in kelvin is already quite extreme

brews commented 2 years ago

So we can keep track of it, can someone list out the downscaleCMIP6 issues this is related to? This will create links and it will be easier to keep track of what needs to be rerun.

I see https://github.com/ClimateImpactLab/downscaleCMIP6/issues/476. What else?

Edit: Also, I'd be careful because this doesn't fully close the issues upstream in downscaleCMIP6. This is an upgrade we need, but we won't actually close it until we upgrade the Argo Workflows and container images in downscaleCMIP6 to take advantage of these new dodola features, @emileten.

brews commented 2 years ago

I took a look at this with a programmer's eye. @dgergel, I'd appreciate it if you could review this and double-check the method actually does what you want/described.

emileten commented 2 years ago

@dgergel @brews I addressed all your concerns and following our conversation, structurally modified things a bit.

floor and ceiling are two separate functions, in services and cli as well. That keeps things clean and there is no step when we're doing both.

@brews I am modifying the header of this to include all related issues.

brews commented 2 years ago

@emileten BTW, I think you can merge this whenever you're ready!