How much graphics memory is required to use the latest weights to generate text images? (Mine is 3060, 12G, unable to load model weights at all)

jy0205 / LaVIT

LaVIT: Empower the Large Language Model to Understand and Generate Visual Content

Other

438 stars 22 forks source link

Closed shams2023 closed 2 months ago

shams2023 commented 3 months ago

How much graphics memory is required to use the latest weights to generate text images? (Mine is 3060, 12G, unable to load model weights at all)

jy0205 commented 2 months ago

It requires at least 22GB to load the model.

shams2023 commented 2 months ago

它至少需要 22GB 来加载模型。

Is there an int8 weight?

jy0205 commented 2 months ago

We don't have that yet