hemingkx / Spec-Bench

Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)
https://sites.google.com/view/spec-bench
Apache License 2.0
107 stars 11 forks source link

Add IBM speculator models? #10

Open njhill opened 4 weeks ago

njhill commented 4 weeks ago

Thanks for this nice work!

We have found that these outperform the other techniques: https://arxiv.org/abs/2404.19124

Some trained speculator models can be found here: