search

luminai-companion / filament

A Python API for talking with KoboldAI with request and response data manipulation.
GNU General Public License v3.0
3 stars 1 forks source link

Implement pass-through API #1

Closed Pleasant-Cry closed 1 year ago

Pleasant-Cry commented 1 year ago

We will implement a pass-through API that will take a request from TavernAI and pass it unmodified to KoboldAI and then return KoboldAI's response back to TavernAI.

Pleasant-Cry commented 1 year ago

Commit 6e9a6ed is a first crack at implementing wildcard GET proxying. Still needs work. FastAPI is async so we shouldn't be using requests but rather httpx to make async calls to the KoboldAI API, but I haven't been smart enough to figure that all out just yet. Once GETs are working well we can move on to the rest of the PUT/POST/DELETE methods.