search

GAIR-NLP / anole

Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation
https://huggingface.co/spaces/ethanchern/Anole
618 stars 33 forks source link

Transformers changes #12

Open winglian opened 1 month ago

winglian commented 1 month ago

Great job! Would it be possible to upstream your transformer changes (or at least provide a diff of the changes)? Long term it isn't sustainable to run off of a transformers fork. If you could provide the date/git sha you forked from that would be helpful too.

EthanC111 commented 1 month ago

Thank you for your interest! We will update the transformer changes once the Chameleon PR get merged: https://github.com/huggingface/transformers/pull/31534 (Actually we might consider submit a PR ourselves to help the transformer library directly support Anole!)

winglian commented 1 month ago

looks like this is the where it was forked from transformers https://github.com/huggingface/transformers/commit/8b7cd402738c97825bc52e53632c8cef41906d2f

I managed to extract the patch to this branch that you could clone and submit as a PR.

https://github.com/huggingface/transformers/compare/main...winglian:transformers:chameleon-anole?expand=1