Open jorgeantonio21 opened 4 weeks ago
The proxy will act as a 'middleware' receiving http requests for various endpoints (which should be compatible with OpenAI's API standard). Each endpoint simply calls a suitable node, to which the proxy owns enough compute units within a Stack.
Stack
Chat completions has been addressed in #23
The proxy will act as a 'middleware' receiving http requests for various endpoints (which should be compatible with OpenAI's API standard). Each endpoint simply calls a suitable node, to which the proxy owns enough compute units within a
Stack
.