Closed Armandpl closed 5 months ago
alright so quanser sim diverges too, it seems that's due to the integration step being too big. I'm guessing it wasn't diverging before because of the speed limits i was enforcing. they were probably also preventing the sim from diverging.
The quanser sim doesn't expect a reduction ratio, fix that and try sim2real to gauge if the sim is anything close to reality. (Hoping it is so we can pre-train our dreamer world model)
Take the opportunity to also fix things we need for dreamer v3:
75
env = gym.make("furuta:FurutaSim-v0)
add dt obsnot just yet, let's try without and improve from therefix the PID that is supposed to stop the motor