Consider next version to use LLM instead of UNet

OpenMOSS / AnyGPT

Code for "AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling"

779 stars 61 forks source link

Consider next version to use LLM instead of UNet #23

Closed matbee-eth closed 4 months ago

matbee-eth commented 5 months ago

It would be a VERY interesting project to utilize the Unet in combination with the LLM + Time-Aware Semantic Connector for generating images as the ELLA project had shown.

Not an issue, but it would be fantastic as the LLM is already loaded in memory.