search

OoriData / OgbujiPT

Client-side toolkit for using large language models, including where self-hosted
Apache License 2.0
101 stars 8 forks source link

[#39] Switch to class-based wrapper for LLM endpoints/handlers #41

Closed uogbuji closed 11 months ago

uogbuji commented 11 months ago

Major improvement to our API. Cleans up a bunch of stuff & also adds support for chat completion.

uogbuji commented 11 months ago

For now only demo updated is demo/multiprocess.py. Use that to see how the new API works.

Aidan-Reese commented 11 months ago

👍🏻