guoyww / AnimateDiff

Official implementation of AnimateDiff.
https://animatediff.github.io
Apache License 2.0
10.44k stars 859 forks source link

Rotate around object LORA [feature request] #171

Open 3dpartdesign opened 1 year ago

3dpartdesign commented 1 year ago

I've thought that if I have LORA which allows rotating cameras around object then it could be possible to do some photogrammetry over that (text -> 2d -> 3d). So having that LORA would open new opportunities for 3D scanning. It would be rough (because of micro changes) but maybe worth trying.

Thanks for developing that!!!

oo0o00oo0 commented 3 months ago

I've thought that if I have LORA which allows rotating cameras around object then it could be possible to do some photogrammetry over that (text -> 2d -> 3d). So having that LORA would open new opportunities for 3D scanning. It would be rough (because of micro changes) but maybe worth trying.

Thanks for developing that!!!

Did you ever have any luck progressing this idea? I'm looking at this workflow combined with gaussian splatting - using a sequence of basisc input renders to define the point cloud then applying stylised images in the gaussian splatting stage.