search

hao-ai-lab / LookaheadDecoding

Apache License 2.0
1.04k stars 63 forks source link

flash attention and sampling #50

Closed Viol2000 closed 4 months ago