How much the memory cost when training video generation model?

cure-lab / MagicDrive

[ICLR24] Official implementation of the paper “MagicDrive: Street View Generation with Diverse 3D Geometry Control”

https://gaoruiyuan.com/magicdrive/

GNU Affero General Public License v3.0

664 stars 40 forks source link

How much the memory cost when training video generation model? #80

Closed csyufei closed 2 months ago

csyufei commented 2 months ago

Thank you for your good job! I input 16 frames, each with 6 view images, and do not use xformers, but When I implement the sentence, the memory consumed more than 80G. So is this the reason that I do not use xformers?

flymin commented 2 months ago

We have solved your issue through email.