jawerty
commented
1 year ago Hi @PeaceMaker666 I love that you brought this up. This is a solid issue. You can implement the code if you'd like ofc. If you do make a PR implementing llama.cpp that's be great. I also want to implement that for this but likely won't get to it for a couple weeks. If you do make a PR try to keep it in the general coding pattern that's been laid out (DRY, classes, single purpose functions, etc.). Then i'll code review and we can work together to get it merged.
Otherwise i'll keep this issue up and once I have time try to sort it out.
It would be fantastic if you added the ability to use this solely on the PC without the need for the flask. I saw the note and thought I'd oblige. on a side note, I love the way your mind works. Just in case I don''t crate many issues. When I do am I supposed to implement the code and then ask for the suggestion. I mean i can, if needed or if you like, I just don't know what the protocall is.