Open dgcnz opened 1 week ago
Should've looked at the PRs, it seems it's already being fixed at https://github.com/pytorch/ao/pull/977. Leaving this issue open in case anyone stumbles on the same error. Feel free to close it.
same problem.
yeah, we are fixing this here: https://github.com/pytorch/ao/pull/1141
Description
torchao.autoquant
fails when running it with a model that usestorch.nn.MultiheadAttention
. I think it might be related to https://github.com/pytorch/pytorch/issues/72186#issuecomment-1028326358.Minimum reproducible program
Error Logs
Environment