Closed paolorechia closed 1 year ago
@iGavroche honestly, I don’t know if we want to merge this as it is - maybe wait for @Karajan421 ‘s llama cpp bindings first?
We could also add feature flags but might be a lot of effort to revert the changes now behind a flag.
Marvelous!
We could also add feature flags but might be a lot of effort to revert the changes now behind a flag.
I'll leave the decision up to you, @paolorechia, as long as it doesn't get stale in this branch 😊
Let’s merge it, then, even if it’s not ideal yet - we can improve it over time. I’ll just wait for @Karajan421 ’s opinion in Discord
@iGavroche please take a look at the updated README - please note that this version does not support CPU usage. We need the llamacpp bindings version that @Karajan421 is working on for that.