search

cure-lab / MagicDrive

[ICLR24] Official implementation of the paper “MagicDrive: Street View Generation with Diverse 3D Geometry Control”
https://gaoruiyuan.com/magicdrive/
GNU Affero General Public License v3.0
419 stars 22 forks source link

Conditioning on Segmentation Maps #28

Closed samueleruffino99 closed 4 weeks ago

samueleruffino99 commented 2 months ago

Hello, great work!

I was wondering whether you thougth about conditioning on the image segmentation maps (generated with some algorithm on NuScenes images). Because I am not quite sure, I would expect segmentation maps have more information about the shapes of the scene/objects compared to 3d bboxes + class, but maybe it is not the case if you already considering and discraded it.

Thank you!!

flymin commented 1 month ago

It is possible and you can search for many excellent works on that application. Since segmentation maps are 2D, for instance, controlnet can already support this. In this paper, we only consider 3D controls. Thanks.