search

FasterDecoding / SnapKV

141 stars 4 forks source link

Can I use the SnapKV without the flash-attention ? #15

Closed pengshuang closed 3 weeks ago

pengshuang commented 3 weeks ago

Thank you for making the SnapKV code public.

I would like to ask if SnapKV can be used without flash-attention?

Zhutianyi7230 commented 3 weeks ago

I have the same question. Can you run SnapKV without flashattention?