How to TRAIN the int8 quant model?

siliconflow / onediff

OneDiff: An out-of-the-box acceleration library for diffusion models.

https://github.com/siliconflow/onediff/wiki

Apache License 2.0

1.4k stars 85 forks source link

Open CuddleSabe opened 5 days ago

CuddleSabe commented 5 days ago

企业微信截图_17191961315895 测试int8量化发现效果会有一些损失，请问我们后续如何在int8上进行微调以弥补损失？

CuddleSabe commented 5 days ago

@strint

strint commented 5 days ago

@CuddleSabe 你在试用企业版么

CuddleSabe commented 4 days ago

@CuddleSabe 你在试用企业版么

不是试用，公司用了比较久了

strint commented 4 days ago

@CuddleSabe 你在试用企业版么

不是试用，公司用了比较久了

@CuddleSabe 有微信之内的联系方式我们看看怎么样。直接看这个 issue 没有完全明白