search

DeepX-inc / machina

Control section: Deep Reinforcement Learning framework
MIT License
278 stars 45 forks source link

CEMDeterminsticsSAVFunc take too much batch_size. #221

Closed iory closed 5 years ago

iory commented 5 years ago

In CEMDeterminsticsSAVFunc, _cem function take too much batch_size. This is fast but there is a problem with taking too much GPU memory. In current implementation, (self.num_sampling * self.batch_size ) is equal to batch_size. https://github.com/DeepX-inc/machina/blob/master/machina/vfuncs/state_action_vfuncs/cem_state_action_vfunc.py#L87-L88

I think that it is desirable to have an option of whether taking too much batch_size or not.

takerfume commented 5 years ago

I previously implemented _cem using for-sentense. I will recover that version and add option.

takerfume commented 5 years ago

224