search

carla-simulator / carla

Open-source simulator for autonomous driving research.
http://carla.org
MIT License
11.22k stars 3.63k forks source link

Controlling Pedestrians with Motion Capture Devices in Carla #7704

Closed Ikaros520520 closed 4 months ago

Ikaros520520 commented 4 months ago

Hello, everyone！

I'm new to using Carla.

I have a motion-capture set on hand. I want to use this set to control the pedestrians in Carla. As shown in the following documentation (https://arxiv.org/pdf/2206.00337). I didn't find anything in Carla's documentation that would help me. There is no detail in the above paper on how the motion capture device controls pedestrians. Whether it's a relevant help document, a specific step-by-step procedure, or a similar example, please let me know. Much appreciated!

CARLA version:0.9.12 Platform/OS:Window10 Motion Capture Equipment:Perception Neuron Studio(https://neuronmocap.com/pages/perception-neuron-studio-system)

GoodarzMehr commented 4 months ago

Hi,

You can take a look at the WalkerBoneControl class and the Walker class' apply_control method for your specific version. I think newer versions have some expanded control which you can also check out in the documentation.

DnDare commented 4 months ago

Hi, Thanks GoodarzMehr, We don't have at Carla any documentation on adding real-time motion-capture. You'll have to research by yourself , or ask the authors of the paper you mentioned. Sorry about that.

There is an issue related to pedestrians, explains a little about animgraphs, and how we made it in Carla.

If you review this video, you might get some insights on how to connect MOCAP to the simulation.

Hope it helps,

Ikaros520520 commented 4 months ago

Thanks for the help! I finally found out how to drive the UE character models through the official help documentation for the motion capture device(Perception Neuron Studio).