search

openclimatefix / nowcasting_utils

Common functionality between SatFlow and predict_pv_yield
https://nowcasting-utils.readthedocs.io/en/stable/
MIT License
3 stars 0 forks source link

Use new plotting tools to check manually check through the data #57

Open JackKelly opened 3 years ago

JackKelly commented 3 years ago

Now that @peterdudfield has implemented some plotting functions (in #46), it'd be great to plot a bunch of batches to visually inspect the data going into our models, to make sure we're training our models on sane data :slightly_smiling_face:

JackKelly commented 3 years ago

We can probably close this issue when https://github.com/openclimatefix/nowcasting_dataloader/pull/92 is finished

peterdudfield commented 3 years ago

Yea, I was thinking of dividing up the plotting functions - maybe some overlap.

Esentially plotting Batch, will be slightly different from plotting BatchML. The models should receiver something like BatchML and then can be plotted then

JackKelly commented 3 years ago

Sounds good!

My notebook in nowcasting_dataloader is (almost) entirely focused on plotting the tensors that are produced by SatFlowDataset: I wanted to get as close as possible to what the ML models are seeing; and plot the position encodings. For diagnosing ML training issues, I think it's important to see exactly what the ML model is seeing...

peterdudfield commented 3 years ago

Thats good - go that we are not doubling work