Mixed-model speculative sampling

anarchy-ai / LLM-VM

irresponsible innovation. Try now at https://chat.dev/

https://anarchy.ai/

MIT License

477 stars 148 forks source link

Open VictorOdede opened 11 months ago

VictorOdede commented 11 months ago

We want to be able to do speculative sampling with any models

bilal-aamer commented 11 months ago

We want to be able to do speculative sampling with any models

Sure @VictorOdede, however what does Mixed-model speculative sampling mean?