lucoiso / UEHttpGPT

HttpGPT is an Unreal Engine plugin that facilitates integration with OpenAI's GPT based services (ChatGPT and DALL-E) through asynchronous REST requests, making it easy for developers to communicate with these services.
https://forums.unrealengine.com/t/free-httpgpt-integrate-chatgpt-in-the-engine-via-asynchronous-tasks-rest/765168?u=lucoiso
MIT License
202 stars 50 forks source link

API requests supporting local deployment of OpenAI-Compatible Server #96

Open Yimi81 opened 10 months ago

Yimi81 commented 10 months ago

Currently, there are many LLMs in the open-source community, along with several reasoning frameworks that support server deployment following the OpenAI API protocol (e.g. vLLM, api-for-open-llm, etc). API requests supporting local deployment of servers are quite useful.