openclimatefix / power_perceiver

Machine learning experiments using the Perceiver IO model to forecast the electricity system (starting with solar)
MIT License
7 stars 1 forks source link

Why do we sometimes get NaNs in the PV data? #159

Closed JackKelly closed 2 years ago

JackKelly commented 2 years ago

image

image

image

JackKelly commented 2 years ago

I think the data loading code is behaving as before. What's new is that, now, the code that creates the solar position now cares about missing PV data. Maybe the fix is to return nan solar position if all PV systems are nan. And make sure the loss and attention masks missing PV systems

JackKelly commented 2 years ago

It's for a GSP in deep northern Scotland!

image

image

JackKelly commented 2 years ago

This is fixed now :slightly_smiling_face:

I'll create another issue to create a unittest for this.