search

leejet / stable-diffusion.cpp

Stable Diffusion and Flux in pure C/C++
MIT License
3.44k stars 294 forks source link

Parameters changed for "ggml_flash_attn_ext" #384

Open paulocoutinhox opened 2 months ago

paulocoutinhox commented 2 months ago

Hi,

Im getting this error with latest GGML:

/Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/stable-diffusion/ggml_extend.hpp:744:15: error: no matching function for call to 'ggml_flash_attn_ext'
        kqv = ggml_flash_attn_ext(ctx, q, k, v, mask, scale, 0);
              ^~~~~~~~~~~~~~~~~~~
In file included from /Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/stable-diffusion/util.cpp:13:
In file included from /Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/stable-diffusion/preprocessing.hpp:4:
In file included from /Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/stable-diffusion/ggml_extend.hpp:23:
In file included from /Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/ggml/include/ggml-alloc.h:3:
/Users/paulo/Developer/workspaces/cpp/ai-kit/vendor/ggml/include/ggml.h:1803:35: note: candidate function not viable: requires 8 arguments, but 7 were provided
    GGML_API struct ggml_tensor * ggml_flash_attn_ext(

Thanks.

SkutteOleg commented 2 months ago

Try #378

paulocoutinhox commented 2 months ago

Thanks, it works.

SkutteOleg commented 2 months ago

Should be fixed by https://github.com/leejet/stable-diffusion.cpp/pull/380