georghess / neurad-studio

[CVPR2024] NeuRAD: Neural Rendering for Autonomous Driving
https://research.zenseact.com/publications/neurad/
Apache License 2.0
346 stars 24 forks source link

Tutorials about actor edits(removal, shift, add a new vehicle). #11

Closed TurtleZhong closed 6 months ago

TurtleZhong commented 6 months ago

I'm not sure if I missed something, but I think this project supports some editing operations for actors, as I have seen related examples in the paper. However, I didn't find any instructions regarding this in the usage documentation(README). I am wondering if there are any tutorials or additional links available that could provide guidance on this matter?

image

carlinds commented 6 months ago

Hi! You can modify actor trajectories by changing the position and orientation parameters held by the DynamicActors-class (see nerfstudio/model_components/dynamic_actors.py).

We have implemented a few examples of modifications in our render scripts (see https://github.com/georghess/neurad-studio/blob/main/nerfstudio/scripts/render.py). Have a look at RenderInterpolated and DatasetRender for some inspiration if you want to do your own custom edits.

atonderski commented 6 months ago

In the viewer there are also controls (bottom of the list) for experimenting with actor editing in realtime

georghess commented 6 months ago

Closing this for now, feel free to re-open if you find any issues with this :)