search

hemingkx / Spec-Bench

Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)
https://sites.google.com/view/spec-bench
Apache License 2.0
107 stars 11 forks source link

Add Hydra #1

Closed Aphoh closed 3 months ago

Aphoh commented 4 months ago

Maybe consider adding Hydra to these? It's a very similar approach to EAGLE, so I'd be curious to see what the performance difference is.

hemingkx commented 4 months ago

Thx for the advice👏! We are working on it and will update the results.

hemingkx commented 3 months ago

Hydra has been integrated into Spec-Bench. We updated the speedup results on NVIDIA 3090, check it out!👏