tspooner / rsrl

A fast, safe and easy to use reinforcement learning framework in Rust.
https://crates.io/crates/rsrl
MIT License
178 stars 13 forks source link

Revise trace interface #41

Open tspooner opened 5 years ago

tspooner commented 5 years ago

At the moment we handle traces with an enum type that has multiple implementations including replacing and accumulating etc. These cannot be extended. Also, the construction of these objects is clunky at best and even I usually have to look up the constructor definition.

This should be streamlined. Users should be able to extend it themselves. Further, if the user so chooses it would be nice to hide this away and just have sensible defaults, while still allowing more advanced usage.