Is there a plan to fix thread-safe problem in inferring?

GAIR-NLP / anole

Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation

https://huggingface.co/spaces/ethanchern/Anole

618 stars 33 forks source link

Open YiFang99 opened 1 month ago

YiFang99 commented 1 month ago

Is this model going to support batch generation for multimodal?

JoyBoy-Su commented 1 month ago

Thanks a lot for your interest! We will add this to our TODO list!

YiFang99 commented 1 month ago

Really great work! Looking forward to more modules!