Implement support for llama.cpp low-level HTTP API

OoriData / OgbujiPT

Client-side toolkit for using large language models, including where self-hosted

Apache License 2.0

102 stars 8 forks source link

Closed uogbuji closed 8 months ago

uogbuji commented 8 months ago

Still needs more test case work, but planning to merge today nevertheless.