Open mattolson93 opened 1 month ago
Yes, that's expected. A workaround would be to fully re-import all the imports that are done in adapt_transformers_to_gaudi
, but it's not that straightforward to do. Let's see if some other people encounter this issue and in that case I'll give a higher priority to it.
Would it be hard to throw a warning? I can imagine myself running into this problem again in a few months and not realizing I put the call in the wrong spot.
System Info
Information
Tasks
examples
folder (such as GLUE/SQuAD, ...)Reproduction
Running minimal llava inference code fails (on cpu or hpu). I have also verified on original llava (if you want that example). Change line 7 to false to verify it the correct behavior.
Expected behavior
the output should say "The image features a red stop sign on a" rather than " ss wasteAsian\n\n\nt".