Open Armandpl opened 7 months ago
maybe i should start from https://github.com/kc-ml2/SimpleDreamer and upgrade it to dreamer v3?
even before that I should take a look at hardware acceleration, what is even tinygrad, what's the different between it and torch. Few leads:
Why re-implement Dreamer even though there already exist implementations on GitHub:
drowned in their library was a bit harsh lmao implementation seems to be really clear and well commented. They do use a Fabric Module and idk what it is but whatever. seems like a nice ressource. really like that the dreamer.py file starts with the interesting stuff!!
Motivations:
I feel like there might be an opportunity to start by ripping out stuff i don't need for this problem from the dreamer code and then building it back up? for example I don't think I need to encode the state since it is already very small? I don't need any image stuff, don't need to rescale the reward, what else can I remove at first?