alexcbb / Genie-Generative-Interactive-Environments

This repo aims to reproduce and open the results obtained from "Generative Interactive Environments" of Google DeepMind.
MIT License
5 stars 2 forks source link

[Feature] ST Transformer Layer #1

Open alexcbb opened 6 months ago

alexcbb commented 6 months ago

Feature details

One of the most important part of the model is the spatio-temporal transformer layer used in the model. It is a memory efficient version from ViT

This layer combines the idea from the original idea with Vision Transformer.

What needs to be done