LlamaFlashAttention2 `__init__` is undefined. - Githubissues

opendilab / LMDrive

[CVPR 2024] LMDrive: Closed-Loop End-to-End Driving with Large Language Models

Apache License 2.0

526 stars 48 forks source link

LlamaFlashAttention2 `init` is undefined. #60

Open Luke20000429 opened 2 weeks ago

Luke20000429 commented 2 weeks ago

The LlamaFlashAttention2 has no __init__(). As a result running the system with flash-attn will crash. https://github.com/opendilab/LMDrive/blob/ae0643d071b08b38cd326314bcbfb44aa4e60232/LAVIS/lavis/models/blip2_models/modeling_llama.py#L415