Fix "not enough space in the context's memory pool" - Githubissues

bigcode-project / starcoder.cpp

C++ implementation for 💫StarCoder

445 stars 36 forks source link

Fix "not enough space in the context's memory pool" #6

Closed NouamaneTazi closed 1 year ago

NouamaneTazi commented 1 year ago

Fixes https://github.com/bigcode-project/starcoder.cpp/issues/3 Inspired by https://github.com/ggerganov/ggml/pull/176