Feature Request: LLM Restful format customizable

unit-mesh / auto-dev

🧙‍AutoDev: The AI-powered coding wizard（AI 驱动编程助手） with multilingual support 🌐, auto code generation 🏗️, and a helpful bug-slaying assistant 🐞! Customizable prompts 🎨 and a magic Auto Dev/Testing/Document/Agent feature 🧪 included! 🚀

https://ide.unitmesh.cc/

Mozilla Public License 2.0

2.73k stars 314 forks source link

Feature Request: LLM Restful format customizable #25

Closed hotip closed 11 months ago

hotip commented 1 year ago

Currently Restful format has 2 style, OpenAI and Azure , and Custom means Azure.

should be customizable for:

set custom Header (for example: google's PaML2 api not need a Authorization header)
append key to Url (for example: google's PaLM2 api append its key in url)
customizable request body format

phodal commented 1 year ago

Haha, welcome to PR ~

phodal commented 1 year ago

@hotip 记得更新文档：https://github.com/unit-mesh/auto-dev/blob/master/docs/custom-llm-server.md