search

deep-floyd / IF

Other
7.63k stars 495 forks source link

Lighter text encoder #101

Open igor-davidyuk opened 1 year ago

igor-davidyuk commented 1 year ago

Hey guys, thank you for the awesome repo! Is there any chance that you will support a lighter tex encoder?

phalexo commented 1 year ago

If by lighter you mean requiring less VRAM, then you can try to set the dtype to float16. T5 is then about 11.6GiB.

igor-davidyuk commented 1 year ago

If by lighter you mean requiring less VRAM, then you can try to set the dtype to float16. T5 is then about 11.6GiB.

Thank you for your advice, but my CU does not support fp16 operations. Anyway, it looks like T5 XXL is too big and a smaller embedder would do