thunlp / Ouroboros

Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)
Apache License 2.0
77 stars 9 forks source link

fix: fix num_layers hardcoding #7

Closed Chlience closed 1 month ago

Chlience commented 1 month ago

fix #6