search

nickgkan / 3d_diffuser_actor

Code for the paper "3D Diffuser Actor: Policy Diffusion with 3D Scene Representations"
https://3d-diffuser-actor.github.io/
MIT License
228 stars 28 forks source link

Performance on RLBench is quite different with proposed results #71

Open JaehongJaehongMin opened 1 month ago

JaehongJaehongMin commented 1 month ago

Hi, Thank you for the kind introduction for your code!

By the way, I've reproduced 3D Diffuser Actor on RLBench, obtaining slightly different performance with the results in the paper.

Well, it could infer well most of the tasks included here, but there were some performance drop in some tasks (ex. Place cups, Place wine at rack location, Stack blocks, Stack cups).

Here is my reproduction results below. image

Could you please explain why the model's performance is not as expected?

twke18 commented 1 month ago

Hi,

Could you illustrate what are the setup you used to reproduce the results? We've been testing the model multiple times and didn't find the performance drop.