search

ali-vilab / composer

Official implementation of "Composer: Creative and Controllable Image Synthesis with Composable Conditions"
MIT License
1.53k stars 48 forks source link

What would the hardware requirements be for the the 5B parameters model? #1

Closed ninjasaid2k closed 1 year ago

ninjasaid2k commented 1 year ago

What would the hardware requirements be for the the 5B parameters model? would it be possible on consumer grade hardware?

huanglianghua commented 1 year ago

@ninjasaid2k With simple acceleration (i.e., half precision, flash attention), Composer requires approximately 28GB of GPU memory for inference.

It would be possible to further reduce the memory consumption with, e.g., uint8 quantization and TensorRT to make it run on consumer grade GPUs.