search

yorkeyao / VehicleX

VehicleX: Simulating Content Consistent Vehicle Datasets with Attribute Descent (ECCV 2020, TPAMI 2023)
155 stars 19 forks source link

car keypoint extraction #15

Open srikanthmalla opened 2 years ago

srikanthmalla commented 2 years ago

Hi, Thanks for open sourcing such an amazing simulator. Is there any update on the keypoint generation using the vehicle X interface (https://github.com/yorkeyao/VehicleX/issues/6)? If the annotations are not available, can you point us to how to access 3D models (so we can annotate 3d keypoints) and how to put them in the plugin to generate 2d locations of the keypoints? Please let us know.

Thank you!

yorkeyao commented 2 years ago

Thank you for your question. For now, we do not have future plans to release the keypoint annotation.

You can find 3d models in our Unity project: https://github.com/yorkeyao/VehicleX/tree/master/Unity%20Source.

You may need to annotate 3d keypoints first. You can imagine those 3D keypoints as tiny objects attached to different part of a vehicle. Thus when you film an image with the camera, you can simply get 2d locations. In terms of realization, you can use a different layer for 3D keypoints in Unity.

srikanthmalla commented 2 years ago

Hi @yorkeyao , Thanks for the reply. I am new to unity. In the issue (https://github.com/yorkeyao/VehicleX/issues/6), you mentioned you annotated a few. Is it possible to provide an example with a single vehicle cad model (in this repo)?