Work On CPU - Githubissues

Infini-AI-Lab / Sequoia

scalable and robust tree-based speculative decoding algorithm

307 stars 31 forks source link

Open ZepinLi opened 4 months ago

ZepinLi commented 4 months ago

Hi Sequoia team,

Can this code framework fit in cpu devices? If so, how can we do it? Any insights?

Regards