rwth-i6 / returnn_common

Common building blocks for RETURNN configs, such as models, training concepts, etc
7 stars 4 forks source link

More explicit support for reinforcement learning #19

Open albertz opened 3 years ago

albertz commented 3 years ago

returnn-common should come with simple ways to use common building blocks / mechanisms of reinforcement learning, which can be useful in general.

This issue is supposed to be a collection of things we need. Although we probably should have individual issues for each individual feature.

(I consider this as resolved when we have some simple RL examples, which seems simple enough. E.g. producing some common actor critic training example on some common task. Basically reproducing some of the basic examples of other RL frameworks. Only when we have that, we know that returnn-common covers the basic needed utilities.)

albertz commented 2 years ago

Similar thoughts for PyTorch on what functionality a generic framework should provide: https://twitter.com/kaixhin/status/1482569357213712389/photo/1