princeton-vl / infinigen

Infinite Photorealistic Worlds using Procedural Generation
https://infinigen.org
BSD 3-Clause "New" or "Revised" License
5.31k stars 454 forks source link

How to generate videos of indoor scenes? #290

Open SergioArnaud opened 1 month ago

SergioArnaud commented 1 month ago

I ran the following command

python infinigen.manage_jobs.py --output_folder outputs/go_big_go_home --num_scenes 32 --pipeline_configs local_256GB.gin monocular_video.gin indoor_background_configs.gin --configs singleroom.gin fast_solve.gin --pipeline_overrides get_cmd.driver_script=infinigen_examples.generate_indoors --overrides compose_indoors.restrict_single_supported_roomtype=True --overwrite

In particular notice that I'm using the monocular_video.gin config. The issue I'm observing is that the images generated (Image_0_0_0001_0, Image_0_0_0002_0, ...) are exactly the same. Notice attatched Image_0_0_0001_0 and Image_0_0_0004_0.

Do you have any advice on how I can debug this?

Image_0_0_0001_0 Image_0_0_0004_0

araistrick commented 1 month ago

base_indoors.gin contains compose_indoors.animate_cameras_enabled = False, so you may have to remove this line to get the camera to move.

This line was added because I found our camera pathfinding script from nature had a low successrate in indoor scenes. It has not been fixed fully (I am working on this) but you can remove this line if you want to play with it for now.

SergioArnaud commented 1 month ago

Thanks for the context @araistrick !