Closed machengcheng2016 closed 8 months ago
Greetings! Thanks for your great work! When I do inference, I find such error: AttributeError: 'MPLUGOwl2LlamaModel' object has no attribute '_use_flash_attention_2'
Seems something is missing. Could you give me a solution, please?
Solved. Refer to this issue.
Greetings! Thanks for your great work! When I do inference, I find such error: AttributeError: 'MPLUGOwl2LlamaModel' object has no attribute '_use_flash_attention_2'
Seems something is missing. Could you give me a solution, please?