Make educational example of different normalisation, color bar, etc...

[eguil]

Use a MC to show different options of portrait plots:

• relative diff, RMSE, ratio
• shading vs. numbers
• etc...

[lee1043]

RMSE Portrait plot

Color for normalized metrics value

Color for NON-normalized metrics value

Non-RMSE Portrait plot

Color for normalized metrics value

Color for NON-normalized metrics value

[lee1043]

@eguil @yyplanton @gleckler1 what do you think? Any feedback/suggestion welcome

[gleckler1]

@eguil @yyplanton @gleckler1 Great examples Jiwoo. For the non-normalized RMSE you could make an effort to encapsulate more rows by change the color min/max to 0-5... with that more of the rows will probably not be blue but it will still clearly demonstrate the issue of comparing results from different metrics.

[lee1043]

@gleckler1 great idea, which look like below.

non-normalized RMSE (example 2)

[eguil]

• Use these in presentation for CLIVAR group
• try using max of metrics or average of 5 max
• try defining expert-chosen thresholds

[lee1043]

Another example: Normalized by maximum of each row. [E(model) - E(max)] / E(max)

[eguil]

why don't we get any reds ?

[lee1043]

It is normalized as: [E(model) - E(max)] / E(max), which makes all numbers as negative. Please let me know if you were indicating in different way. I am not sure you meat [E(model) - E(median)] / E(max)?

[gleckler1]

I think they meant E(model)/E(max) … no E(median). So some should be close to one.

[lee1043]

Another example 2: Normalized by maximum of each row. E(model) / E(max)