search

DLR-RM / stable-baselines3

PyTorch version of Stable Baselines, reliable implementations of reinforcement learning algorithms.
https://stable-baselines3.readthedocs.io
MIT License
9.18k stars 1.71k forks source link

Attention mechanism / Transformer architecture #1387

Closed anilkurkcu closed 1 year ago

anilkurkcu commented 1 year ago

🚀 Feature

Hi, since these days attention mechanisms and transformer architectures are everywhere, I thought that it would be good to have this also in SB3. I have found this implementation:

https://peterbloem.nl/blog/transformers

There is also the code available, what is needed is just to be able to create a suitable custom environment that would support it.

Motivation

No response

Pitch

No response

Alternatives

No response

Additional context

No response

Checklist

araffin commented 1 year ago

I have checked that there is no similar issue in the repo

Duplicate of https://github.com/DLR-RM/stable-baselines3/issues/1077 https://github.com/DLR-RM/stable-baselines3/issues/177 and https://github.com/Stable-Baselines-Team/stable-baselines3-contrib/issues/165