openclimatefix / satflow

Satellite Optical Flow with machine learning models
https://satflow.readthedocs.io/en/stable/
MIT License
61 stars 10 forks source link

New Paper: Data2Vec #116

Open jacobbieker opened 2 years ago

jacobbieker commented 2 years ago

Detailed Description

Similar to Perceiver IO (they even reference it in the blog post) this is a modality agnostic model, with a public PyTorch implementation, no weights for vision tasks yet though.

Context

Possible Implementation

https://github.com/pytorch/fairseq/tree/main/examples/data2vec