Meta FAIR Chameleon 7b and 30b

[AmericanPresidentJimmyCarter]

Model description

The model is a LLaMA style architecture with a VQGAN for image input and generation. It is also likely to be finetuned for patch input for images similar to Fuyu, so it would be a good idea to have the implementation flexible for different types of image input. The weights are available under a research license.

Open source status

• [X] The model implementation is available
• [X] The model weights are available

Provide useful links for the implementation

https://github.com/facebookresearch/chameleon

https://ai.meta.com/blog/meta-fair-research-new-releases/

[zucchini-nlp]

Hi! Adding Chameleon to transformers is work in progress and should be finalized soon 🤗