search

hemingkx / Spec-Bench

Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)
https://sites.google.com/view/spec-bench
Apache License 2.0
166 stars 16 forks source link

add evalution for SPACE #7

Closed cteant closed 4 months ago

cteant commented 4 months ago

Support evaluation for SPACE. SPACE is an acceleration techinque that needs fine-tuning the LLMs. We have conducted experiment on Vicuna-v1.3-7B for fair comparison. One need to download the checkpoint before runing the evalution.

hemingkx commented 4 months ago

Thank you for your pull request! We will evaluate the code soon and merge it into the main branch once the evaluation is complete.