search

kijai / ComfyUI-CogVideoXWrapper

1.02k stars 61 forks source link

Totally black video if I use fp16 #240

Closed tdrminglin closed 6 days ago

tdrminglin commented 1 week ago

THUDM/CogVideoX1.5-5B-I2V says their model support fp16. As ComfyUI-CogVideoXWrapper currently can't select THUDM/CogVideoX1.5-5B-I2V, I'm using Kijai/CogVideoX-5b-1.5 instead. But when I use fp16 to run the model ,I get totally black video.

kijai commented 1 week ago

Where does it say that? 1.5 only supports bf16, black outputs with fp16 are expected currently.

tdrminglin commented 1 week ago

Where does it say that? 1.5 only supports bf16, black outputs with fp16 are expected currently.

https://huggingface.co/THUDM/CogVideoX1.5-5B-I2V in their model Introduction, supported Inference Precision are just the same as THUDM/CogVideoX-5b-I2V . My 2080ti GPU is too old to support bf16 ,maybe I should just use fp32 instead.

kijai commented 1 week ago

Probably just copy/pasted from the old model card, the weights are in bf16, they didn't release fp32 weights, as far as I know the model was trained with bf16, so we can't really even get proper fp16 weights.

tdrminglin commented 1 week ago

Probably just copy/pasted from the old model card, the weights are in bf16, they didn't release fp32 weights, as far as I know the model was trained with bf16, so we can't really even get proper fp16 weights.

Thanks for the reply. I just tried fp32+fp8_transformer enabled. I successfully get a valid result, although with low quanlity .