Closed iory closed 5 years ago
@iory Thank you for fixing it!
@rarilurelo It is OK except if we use QT-Opt for grasping like the original paper. In the original paper, exploration policies are switched if grad_step
reaches a certain amount.
Anyway, in machina, there is no need for grad_step
.
Thank you!
In current qtopt,
iterator(traj.random_batch(batch_size, epoch))
is evaluated twice. This PR makes it call only once.