Abort while model is predicting

go-skynet / go-llama.cpp

LLama.cpp golang bindings

MIT License

614 stars 78 forks source link

Abort while model is predicting #329

Open RobinHeitz opened 3 months ago

RobinHeitz commented 3 months ago

Hi there,

I'm using the Predict() function. How can I stop the model/ abort while it is predicting? It seems like there is not binding which can be called to stop.

paulrouge commented 3 months ago

Im looking for the same thing!