search

SafeAILab / EAGLE

[ICML'24] EAGLE: Speculative Sampling Requires Rethinking Feature Uncertainty
https://arxiv.org/abs/2401.15077
Apache License 2.0
548 stars 51 forks source link

training efficiency #64

Open pengfeiwu1999 opened 1 month ago

pengfeiwu1999 commented 1 month ago

when I try to train the EAGLE models by myself, but I found that the GPU usage is always 0% or 3%, I don't know how to solve it

Liyuhui-12 commented 1 month ago

Are you running the training script we provided?