feat(speculative-sampling): Add speculative sampling - Githubissues

go-skynet / go-llama.cpp

LLama.cpp golang bindings

MIT License

650 stars 79 forks source link

feat(speculative-sampling): Add speculative sampling #200

Closed mudler closed 11 months ago

mudler commented 11 months ago

This adds https://github.com/ggerganov/llama.cpp/pull/2926 to the binding

Part of https://github.com/go-skynet/LocalAI/issues/1013