how to use bf16 for onediff

siliconflow / onediff

OneDiff: An out-of-the-box acceleration library for diffusion models.

https://github.com/siliconflow/onediff/wiki

Apache License 2.0

1.61k stars 99 forks source link

Closed lss15151161 closed 2 months ago

strint commented 3 months ago

Just set the model to bf16 data type and compile it with onediff.

strint commented 2 months ago

We haven't supported bfp16 very well for the moment.