Add support for flash attention with use_cache

DachengLi1 / LongChat

Official repository for LongChat and LongEval

Apache License 2.0

504 stars 29 forks source link

Open DachengLi1 opened 1 year ago

Zhuqln commented 1 year ago

thanks for your guys' amazing work ! i want know is this issue associate with vLLM ?