Experiment 1 - Regression Properties

[whitead]

• [ ] choose authentic property
• [ ] accuracy (zero-shot)
• [ ] calibration (zero-shot) - see Wazy/py0 paper for plotting
• [ ] accuracy (few-shot)
• [ ] calibration (few-shot)
• [ ] accuracy (fine-tuning)
• [ ] calibration (fine-tuning)

Make a table - MAE, Log-Likelihood. Also make calibration plot (area one). Do this twice (1) synthetic data (2) real data

[whitead]

https://github.com/uncertainty-toolbox/uncertainty-toolbox/blob/6ea1fed6591923a95d49d8049a197e33d4d8092d/uncertainty_toolbox/recalibration.py#L40

[whitead]

Also please use this experiment/figure to put in your matbert results in!