search

kvcache-ai / ktransformers

A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
Apache License 2.0
745 stars 39 forks source link

[fix] Fix qlen > chunk_size mask is none error #71

Closed Azure-Tang closed 2 months ago

Azure-Tang commented 2 months ago

Fix qlen > chunk_size mask is none error.