search

Equationliu / Kangaroo

Implementation of Kangaroo: Lossless Self-Speculative Decoding via Double Early Exiting
https://arxiv.org/abs/2404.18911
39 stars 5 forks source link

Training procedure of Kangaroo. #2

Closed tim-pan closed 2 months ago

tim-pan commented 4 months ago

Hi Equationliu and all authors, Thanks for your brilliant work in proposing this promising "Kangaroo" method. I am curious about training details of Kangaroo. Could you plz provide the training code of Kangaroo~~?
Thanks in advance.

yangfuwei commented 3 months ago

+1, looking forward your training code. Thanks.

Equationliu commented 3 months ago

Thanks for your interest. We will release our training code soon.

shiyuetianqiang commented 3 months ago

+1, looking forward your training code. Thanks.

oyy2000 commented 3 months ago

+1, very very excited about the whole project!

Equationliu commented 2 months ago

We have released our training code for Kangaroo, thanks for all your interest. :heart::heart: