Can you add an option to use semi precision?

Tps-F / sd-webui-blip2

WebUI extension for using Blip2

MIT License

93 stars 5 forks source link

Can you add an option to use semi precision? #13

Open niaka opened 1 year ago

niaka commented 1 year ago

My GPU is RTX4090, and most of the models loaded through this plugin cannot work on this GPU. The console always prompts for low memory.

I found a model card for flan-t5-xxl on the Huggingface website. There is a description of how to use semi precision, but I don't understand how to write Python code.

Can you add an option to use semi precision? And thank you very much for your work!

Tps-F commented 1 year ago

Good idea!

Tps-F commented 1 year ago

I'm busy this week, I'll write back next week.