search

ArtemisDicoTiar / FastLLM

1 stars 0 forks source link

Additional Idea: lookahead decoding #5

Closed ArtemisDicoTiar closed 7 months ago

ArtemisDicoTiar commented 7 months ago

https://lmsys.org/blog/2023-11-21-lookahead-decoding/

We can somehow utilize lookahead