PKU-YuanGroup / Open-Sora-Plan

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.
MIT License
11.24k stars 1.01k forks source link

Are you evaluating to experiment with Vim? #87

Open bhack opened 6 months ago

bhack commented 6 months ago

https://github.com/hustvl/Vim

bhack commented 6 months ago

A video adaptation (discriminative) it is at https://github.com/scott-yjyang/Vivim

LinB203 commented 6 months ago

Thanks for your suggestions. The results of medical imaging do not appear to be universal, and the generalization of SSM is not yet known.

bhack commented 6 months ago

It Is true but it could be interesting to evaluate in the case it could be more resource efficient.

bhack commented 4 months ago

Another recent very interesting architecture that it would be nice to port to Video: https://github.com/FoundationVision/VAR