georghess / neurad-studio

[CVPR2024] NeuRAD: Neural Rendering for Autonomous Driving
https://research.zenseact.com/publications/neurad/
Apache License 2.0
329 stars 23 forks source link

Several video rendering problems #36

Open potentialming opened 3 months ago

potentialming commented 3 months ago

Thank you for your open-source contribution. I have a few questions I hope you can help with:

How can I render videos from multiple perspectives simultaneously in your simulator? How can I move foreground objects in the scene while the camera is also moving? In other words, how can I render both camera movement and vehicle movement at the same time? Whenever I control a foreground object, the program tends to crash. Did you encounter this issue during your testing? I want to determine if this is an issue with my environment. Thank you again for your great contribution!

georghess commented 3 months ago

Hi,

First, we've spent limited time on creating different rendering configuration, as it is hard to predict how people want to use this.

How can I render videos from multiple perspectives simultaneously in your simulator?

You could take a look at RenderInterpolated

How can I move foreground objects in the scene while the camera is also moving? In other words, how can I render both camera movement and vehicle movement at the same time?

Again RenderInterpolated has some functionality for this, but it's rather rudimentary.

Whenever I control a foreground object, the program tends to crash. Did you encounter this issue during your testing? I want to determine if this is an issue with my environment.

Have not seen any issues with this. Could you provide more detail (what commands, what error messages etc.)?