changhaonan / A3VLM

[CoRL2024] Official repo of `A3VLM: Actionable Articulation-Aware Vision Language Model`
89 stars 3 forks source link

How can I obtain the 3D coordinates of an arrow? #6

Closed XiangdongHe closed 1 month ago

XiangdongHe commented 1 month ago

Dear author, thank you for your outstanding open-source contribution.

In your description, you can mark the target object with 8 points in the image and use an arrow to indicate the sliding direction or axis.

I found in your code that the get_bbox_3d_proj() method is used to obtain the 3D coordinates of 8 points. May I ask how to obtain the 3D coordinates coordinates of the arrow?

Looking forward to your guidance.

XiangdongHe commented 1 month ago

Is the 3D coordinate of the arrow related to the get_ axis_3d() and get_ axis_proj() methods?

changhaonan commented 1 month ago

Which file you are talking about? If you are talking about during generation get_ axis_3d() will return 3d axis, and get_ axis_proj() will return projected 3d axis.

changhaonan commented 1 month ago

Is your problem solved?

XiangdongHe commented 1 month ago

Thank you for your reply!! I'm talking about vqa_task_construction.py. I have another question to ask. In your paper, the axis is an arrow that has direction. If the get_axis_3d() method returns [[x1, y1, z1], [x2, y2, z2]], which of these two points is the starting point and which is the ending point of the arrow?

changhaonan commented 1 month ago

The first one is start and second is end.