Try Perceiver again. With tweaks from the Flamingo paper

openclimatefix / power_perceiver

Machine learning experiments using the Perceiver IO model to forecast the electricity system (starting with solar)

MIT License

7 stars 1 forks source link

Open JackKelly opened 2 years ago

JackKelly commented 2 years ago

use a resnet front end
don't explicitly add spatial encoding, because, apparently, CNNs implicitly do that, channel-wise
add (don't concat) temperal encoding
concat the learnt queries with the keys and values (with the "byte array")

This could be a nice way to predict national PV