Closed hanlinxuy closed 1 day ago
I am writing something about dynamic draft trees and just read "EAGLE-2: Faster Inference of Language Models with Dynamic Draft Trees". Your guys' ideas are really cool! So I am wondering when the code can be available?
In 1-2 days
I am writing something about dynamic draft trees and just read "EAGLE-2: Faster Inference of Language Models with Dynamic Draft Trees". Your guys' ideas are really cool! So I am wondering when the code can be available?