Closed tolgacangoz closed 2 months ago
The authors may have used a pre-release version for the tests cc @sayakpaul @dacorvo
You are right.
This PR is complete now.
I am looking forward to seeing (more) quantizations from the field of LLMs!
LLM.int8 experiments are here: https://github.com/huggingface/diffusers/discussions/8746
Thanks for your contributions!
Thanks for merging!
Great blog post!
I might be wrong; isn't the latest stable release of
torch
2.4.0
?