The issue about test the model.

[yusirhhh]

I am currently running the test script:

python  test_entireprocess_in_sapien.py --data_dir data/test_data --num_processes 10 -out_dir "./test_results/result_ori"  --no_gui  --use_mask True

However, I am encountering the following output: The output repeatedly states "no replay data." Could you please advise on how to resolve this issue?

[clorislili]

Did you download the test data or collect your own test data? In the Line 55 of test_one_stick_clean.py, the code aims to replay an interaction environment by loading 'result.json'.

[yusirhhh]

Thanks for your reply. I modified the test data path. But the new issue is as follows:

[yusirhhh]

It seems that I have the original-16.obj file.

[clorislili]

Thanks for your reply. I modified the test data path. But the new issue is as follows:

This is the simulation issue about loading the object. It will not affect on the overall testing as long as you can see the rgb_img.png in testing folder of object id 7130 and 103593.

[yusirhhh]

Thank you. The outcomes of the evaluation for my trained model are as follows:

{'number_of_Safe': 43, 'mani_succ_ration_for_Safe': 0.46, 
'number_of_Door': 14, 'mani_succ_ration_for_Door': 0.64,
'number_of_Display': 35, 'mani_succ_ration_for_Display': 0.14, 'number_of_Refrigerator': 35, 'mani_succ_ration_for_Refrigerator': 0.71, 'number_of_Laptop': 49, 'mani_succ_ration_for_Laptop': 0.97, 'number_of_Lighter': 23, 'mani_succ_ration_for_Lighter': 0.47, 'number_of_Microwave': 37, 'mani_succ_ration_for_Microwave': 0.72, 'number_of_Mouse': 28, 'mani_succ_ration_for_Mouse': 0.96, 
'number_of_Box': 42, 'mani_succ_ration_for_Box': 0.8809523809523809, 'number_of_TrashCan': 46, 'mani_succ_ration_for_TrashCan': 0.69, 'number_of_KitchenPot': 50, 'mani_succ_ration_for_KitchenPot': 0.74, 'number_of_Suitcase': 4, 'mani_succ_ration_for_Suitcase': 0.5, 'number_of_Pliers': 1, 'mani_succ_ration_for_Pliers': 1.0, 'number_of_Remote': 18, 'mani_succ_ration_for_Remote': 0.16666666666666666, 'number_of_Bottle': 32, 'mani_succ_ration_for_Bottle': 0.96875, 'number_of_FoldingChair': 37, 'mani_succ_ration_for_FoldingChair': 0.918918918918919, 'number_of_Lamp': 9, 'mani_succ_ration_for_Lamp': 0.5555555555555556, 'number_of_Dispenser': 7, 'mani_succ_ration_for_Dispenser': 0.8571428571428571, 'number_of_Toilet': 16, 'mani_succ_ration_for_Toilet': 0.9375, 'number_of_Scissors': 11, 'mani_succ_ration_for_Scissors': 0.18181818181818182, 'number_of_Table': 9, 'mani_succ_ration_for_Table': 0.2222222222222222, 'number_of_USB': 25, 'mani_succ_ration_for_USB': 0.36, 'number_of_WashingMachine': 4, 'mani_succ_ration_for_WashingMachine': 0.25, 'number_of_Oven': 24, 'mani_succ_ration_for_Oven': 0.9166666666666666, 'number_of_Faucet': 5, 'mani_succ_ration_for_Faucet': 0.0}
test seen acc on 510.000001 samples is 0.7058823515570934, test unseen acc on 94.000001 samples is 0.5425531857175193