search

openclimatefix / power_perceiver

Machine learning experiments using the Perceiver IO model to forecast the electricity system (starting with solar)
MIT License
7 stars 1 forks source link

Check that we're correctly masking whole examples when they have no PV #161

Closed JackKelly closed 2 years ago

JackKelly commented 2 years ago

I've checked, and I'm pretty sure we're doing the right thing, now.

In commit 1c2d8133483c8d5b88b755cb66d01ff966e1bde0, I added a mask for the TimeTransformer (we've been masking the SatelliteTransformer for a while, now).

We're now masking the attn input on a per-element basis (both for the SatelliteTransformer and the TimeTransformer), and we're masking the loss on a per-element basis.