Integration with Lit-GPT

Infini-AI-Lab / Sequoia

scalable and robust tree-based speculative decoding algorithm

282 stars 29 forks source link

Open tchaton opened 4 months ago

tchaton commented 4 months ago

Hey @dreaming-panda,

This looks really interesting. I wondered if you would be interested to show an integration with Lit-GPT: https://github.com/Lightning-AI/litgpt

Best, T.C

dreaming-panda commented 4 months ago

Let me see.

tchaton commented 4 months ago

Hey @dreaming-panda Thanks for considering it. This would be amazing !