search

SafeAILab / EAGLE

Official Implementation of EAGLE-1 (ICML'24) and EAGLE-2 (EMNLP'24)
https://arxiv.org/pdf/2406.16858
Apache License 2.0
780 stars 79 forks source link

combinable with vllm #10

Closed jiangix-paper closed 9 months ago

jiangix-paper commented 9 months ago

Great work. How can I combine the eagle with vllm？

Liyuhui-12 commented 9 months ago

Thank you for your interest. We will support vLLM in our subsequent updates.

tjtanaa commented 9 months ago

@Liyuhui-12 Great Job~! looking forward to it. May I know what's the timeline to expect EAGLE to be integrated into vLLM?

Liyuhui-12 commented 9 months ago

Thank you for your interest. We are in the process of writing the paper on EAGLE, and after completing the paper, we will integrate vLLM and others.