must be real number, not SymFloat for Qwen/Qwen 7B Model with torch.compile inductor backend.

[Vasanta1]

System Info

Transformers : 4.38.2 Torch : 2.3.0 +cpu Python : 3.8

Faced "must be real number, not SymFloat" error when running Qwen/Qwen-7B Model with auto tokenizer and auto model class from pretrained with torch.compile API. Let me know if any other experiments need to be run.

Who can help?

No response

Information

• [ ] The official example scripts
• [ ] My own modified scripts

Tasks

• [ ] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• [ ] My own task or dataset (give details below)

Reproduction

1. Load Qwen/Qwen 7B with auto pretrained API.
2. Run with torch.compile(model)

Expected behavior

Error : must be real number, not SymFloat

[ArthurZucker]

Hey! Could you try with the latest releases of transformers? 🤗

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.