world-modelz / dreamax

A scalable Dreamer implementation in JAX
MIT License
11 stars 2 forks source link

Master Model Parameter copy #3

Closed XMaster96 closed 2 years ago

XMaster96 commented 2 years ago

Add the moment only the singular world model instants has the model params, witch are hold on the excelerator device. If we want to use multiple world model instances on different devices for inference. We are required to have a master copy and than use it to sync all world model instances with it.

AC: