Create an efficient replay buffer implementation (with serialization support)

[andreaskoepf]

• it should be possible to preload the replay buffer with an existing offline dataset
• to restart training if should be possible to serialize the replay buffer contents