facebookresearch / mae

PyTorch implementation of MAE https//arxiv.org/abs/2111.06377
Other
7.33k stars 1.22k forks source link

Foundational model on hundreds of thousands of custom images. #59

Open INF800 opened 2 years ago

INF800 commented 2 years ago

Hi,

Recently saw the talk in meta events about self-supervised learning by @pdollar. I hope this is the project that was mentioned in the talk.

I've been using detectron2 for instances segmentation for some time now - they give incredible results.

I want to improve 1. Accuracy and 2. Fairness of our predictions by building a foundational model on hundreds of thousands (if PoC is a success, will use millions) of custom images of India and integrate with detectron2.

Would you be kind enough to guide me throughout the journey.

Regards, Rakesh

INF800 commented 2 years ago

P.S Please convert this to discussion if required.

INF800 commented 2 years ago

I would also like to dig a bit deeper on how to properly encode data so that model doesn't recreate original data by any means