search

hao-ai-lab / LookaheadDecoding

[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
https://arxiv.org/abs/2402.02057
Apache License 2.0
1.15k stars 67 forks source link

AttributeError: type object 'GenerationMixin' has no attribute 'greedy_search' #67

Open grandxin opened 2 weeks ago

grandxin commented 2 weeks ago

my transformers version==4.36.2 what's wrong with this?