Power Perceiver Refactor

[jacobbieker]

Pull Request

Description

Refactor PP model into own folder and files. Add HuggingFace Hub support

Fixes #183

How Has This Been Tested?

Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration

• [ ] Yes

If your changes affect data processing, have you plotted any changes? i.e. have you done a quick sanity check?

• [ ] Yes

Checklist:

• [ ] My code follows OCF's coding style guidelines
• [ ] I have performed a self-review of my own code
• [ ] I have made corresponding changes to the documentation
• [ ] I have added tests that prove my fix is effective or that my feature works
• [ ] I have checked my code and corrected any misspellings

[codecov-commenter]

Codecov Report

Merging #190 (58bbde2) into main (b72e05d) will increase coverage by 5.48%. The diff coverage is 36.24%.

@@            Coverage Diff             @@
##             main     #190      +/-   ##
==========================================
+ Coverage   32.99%   38.47%   +5.48%     
==========================================
  Files          43       47       +4     
  Lines        2252     2630     +378     
==========================================
+ Hits          743     1012     +269     
- Misses       1509     1618     +109     

Impacted Files	Coverage Δ
power_perceiver/hub.py	0.00% <0.00%> (ø)
power_perceiver/production/model.py	34.31% <34.31%> (ø)
...ower_perceiver/production/satellite_transformer.py	46.96% <46.96%> (ø)
power_perceiver/production/pvrnn.py	51.51% <51.51%> (ø)
power_perceiver/pytorch_modules/query_generator.py	24.24% <0.00%> (+24.24%)	:arrow_up:
...r_perceiver/pytorch_modules/satellite_processor.py	27.90% <0.00%> (+27.90%)	:arrow_up:
...rceiver/pytorch_modules/mixture_density_network.py	33.33% <0.00%> (+33.33%)	:arrow_up:
power_perceiver/pytorch_modules/utils.py	35.00% <0.00%> (+35.00%)	:arrow_up:
power_perceiver/pytorch_modules/nwp_processor.py	46.66% <0.00%> (+46.66%)	:arrow_up:
power_perceiver/pytorch_modules/self_attention.py	65.15% <0.00%> (+65.15%)	:arrow_up:
... and 1 more

:mega: Codecov can now indicate which changes are the most critical in Pull Requests. Learn more

[jacobbieker]

Hey Jacob,

Would you be able to add a text to just check the model initialises? Im sure we could write lots more, but I think at least that first one would be handy

Yeah, definetely!

[jacobbieker]

@peterdudfield the last error seems to be the same as you were seeing in loading the weights, how did you get around it?