Closed mikelmcdaniel closed 1 month ago
Potential fix (that I didn't test): https://github.com/mikelmcdaniel/transformers/commit/157e20f9a57b097b4c756558d12834696527ebb3
cc @muellerzr @SunMarc this seems like valuable feedback
Yes agreed, I'm reworking the imports today so I'll make sure to run through any accelerated-related errs like this to specify min versions :)
System Info
transformers
version: 4.41.2Who can help?
@muellerzr
Information
Tasks
examples
folder (such as GLUE/SQuAD, ...)Reproduction
pipe = pipeline("text-generation", model="TinyLlama/TinyLlama-1.1B-Chat-v1.0", torch_dtype=torch.bfloat16, device_map="auto")