issues
search
romsto
/
Speculative-Decoding
Implementation of the paper Fast Inference from Transformers via Speculative Decoding, Leviathan et al. 2023.
MIT License
11
stars
0
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Generation using cache gives weird sentences
#1
romsto
opened
2 months ago
1