eloialonso / iris

Transformers are Sample-Efficient World Models. ICLR 2023, notable top 5%.
https://openreview.net/forum?id=vhFu1Acb0xb
GNU General Public License v3.0
804 stars 80 forks source link

please gab code (delta-IRIS ) #20

Closed wassname closed 1 year ago

wassname commented 1 year ago

Hey Eloi, your delta-IRIS idea seems nice. A concrete improvement in the largest limitation of IRIS. I'm sure you've improved other parts of the code. Do you mind please uploading the code? Even just messy code to a branch

After reading your IRIS delta poster/paper, I wodner if you've considered running it for 1M steps so you can contriute to the crafter benchmark?

eloialonso commented 1 year ago

Hey @wassname, thanks for your interest! We are working on a code release for delta-IRIS, it should be out in the next couple of months. We will also include results for Crafter 1M.

wassname commented 1 year ago

Looking forward to it!

I've been experimenting with replacing the dynamics model with a pretrained LLM btw. But it's a negative result:

I just thought I would share in case it's interesting

p.s. hydra sucks

eloialonso commented 1 year ago

Interesting, thanks for sharing your experiment!

wassname commented 7 months ago

Hey @wassname, thanks for your interest! We are working on a code release for delta-IRIS, it should be out in the next couple of months. We will also include results for Crafter 1M.

You're probably very busy, but at least one person (me) is still keen to see this!

In the mean time here are some interesting developments: