Closed EnragedAntelope closed 1 month ago
Sorry. Realized my torchao was outdated, had to build it from source but everything is working again. My apologies. Will leave this in case anyone else has a similar error message, they will need to update torchao to latest per their github version (for some reason pip install --upgrade torchao kept me on 0.1, only building from source updated my version).
System Info
Transformers 4.45.0 torchao 0.1 Python 3.11.9 Windows 11
Who can help?
@SunMarc I'm assuming to tag you because it lists a quantize error?
Information
Tasks
examples
folder (such as GLUE/SQuAD, ...)Reproduction
I originally found this when starting ComfyUI immediately after updating to Transformers 4.45.0, since a new VLM package indicated it needed latest Transformers. Easy to reproduce:
Expected behavior
No errors between Transformers and Torchao. I think something changed in latest Transformers since everything was OK until I updated today.