Validation - Githubissues

krisrs1128 / clouds_dist

Simulation of low-clouds, from weather measures.

4 stars 1 forks source link

Validation #148

Closed vict0rsch closed 4 years ago

vict0rsch commented 4 years ago

Add val_loader
infer n times (see opts.val.nb_of_inferences)
concat all inferences for 1 set of metos into 1 large image ([meto, inference_0, inference_1 ..., real_img])
add metrics (mean, std and iqd=inter quartile distance):
- compute the metrics on the set of all pairs of distances within a set of inferences
- for each metos, compute n inferences, compute n(n-1)/2 distances
- compute the mean/std/iqd of these batch n (n-1) / 2 distances

vict0rsch commented 4 years ago

Before I can merge, I need you to include the validation filters in LowClouds @krisrs1128 as I've done for the EarthData so that we don't include the samples specified in opts.val.val_ids into the trainset (and only those in the valset)