Open igor-davidyuk opened 1 year ago
If by lighter you mean requiring less VRAM, then you can try to set the dtype to float16. T5 is then about 11.6GiB.
If by lighter you mean requiring less VRAM, then you can try to set the dtype to float16. T5 is then about 11.6GiB.
Thank you for your advice, but my CU does not support fp16 operations. Anyway, it looks like T5 XXL is too big and a smaller embedder would do
Hey guys, thank you for the awesome repo! Is there any chance that you will support a lighter tex encoder?