NVlabs / Deep_Object_Pose

Deep Object Pose Estimation (DOPE) – ROS inference (CoRL 2018)
Other
1.03k stars 287 forks source link

Regard trainning my object #307

Open Okabe-Rintarou-0 opened 1 year ago

Okabe-Rintarou-0 commented 1 year ago

Hello, I am training my customized object, i have generated some datasets(use nb_objects to generate many instances in one scene): 00000 after some time of training, i got some results but find it strange: image

I am new to DOPE, so i have no idea what's going on, can somebody give me a hand please?

Okabe-Rintarou-0 commented 1 year ago

here are some images generated by using --save flag train_00000 train_00001

mintar commented 1 year ago

Did you specify the symmetries? See here: https://github.com/NVlabs/Deep_Object_Pose/tree/master/scripts/nvisii_data_gen#handling-objects-with-symmetries

Also please show a visualization of the belief maps.

TontonTremblay commented 1 year ago

To echo @mintar you need to specify the symmetries to get stability.

Okabe-Rintarou-0 commented 1 year ago

@TontonTremblay @mintar Thank you for your replies! Actually I have specified the symmetries through model_info.json:

{
  "symmetries_continuous": [{"axis": [0, 1, 0], "offset": [0, 0, 0]}],
  "align_axes": [{"object": [0, 0, 1], "camera": [0, 0, 1]}, {"object": [0, 1, 0], "camera": [0, 1, 0]}]
}

Here is the obj file, the y-axis is the axis of rotational symmetry: tube.obj

Here is another example with its belief map: 00008 00008_belief

Okabe-Rintarou-0 commented 1 year ago

Is it because my model lacks training?

Okabe-Rintarou-0 commented 1 year ago

I want to detect the tube cap. I am wondering whether my 3d model is real enough? cap_17

Okabe-Rintarou-0 commented 1 year ago

btw, i use --scale to enlarge the object(otherwise it'd be very small)