hao-ai-lab / LookaheadDecoding

[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
https://arxiv.org/abs/2402.02057
Apache License 2.0
1.11k stars 65 forks source link

Update decoding.py #25

Closed eltociear closed 10 months ago

eltociear commented 10 months ago

levle -> level