search

foundation-model-stack / fms-extras

Apache License 2.0
20 stars 9 forks source link

Add Speculator Architecture #6

Closed daviswer closed 9 months ago

daviswer commented 9 months ago

Add support for speculative decoding architecture, with implementations of distinct parallel pretraining and generative inference forward passes.

daviswer commented 9 months ago

I made the Blacking and Snake_Casing changes but it looks like a maintainer needs to approve the automated tests again