search

mindspore-lab / mindcv

A toolbox of vision models and algorithms based on MindSpore
https://mindspore-lab.github.io/mindcv/
Apache License 2.0
230 stars 139 forks source link

add pretrain and finetune pipeline for mae #749

Open sageyou opened 9 months ago

sageyou commented 9 months ago

Motivation

  1. add pretrain and finetune pipeline of mae
  2. update vit: initialization method and pre-scale of attention

Test Plan

(How should this PR be tested? Do you require special setup to run the test or repro the fixed bug?)

Related Issues and PRs

(Is this PR part of a group of changes? Link the other relevant PRs and Issues here. Use https://help.github.com/en/articles/closing-issues-using-keywords for help on GitHub syntax)