unit-mesh / auto-dev

πŸ§™β€AutoDev: The AI-powered coding wizard with multilingual support 🌐, auto code generation πŸ—οΈ, and a helpful bug-slaying assistant 🐞! Customizable prompts 🎨 and a magic Auto Dev/Testing/Document/Agent feature πŸ§ͺ included! πŸš€
https://ide.unitmesh.cc/
Mozilla Public License 2.0
2.62k stars 303 forks source link

Allow customization of initial system prompt #190

Closed zanyatta closed 2 months ago

zanyatta commented 2 months ago

Feature Proposal: Allow customization of initial system prompt

like https://github.com/unit-mesh/auto-dev/issues/175

AutoDev is currently unable to work with LM Studio: image

zanyatta commented 2 months ago

It only seems to affect the "test llm connection"

zanyatta commented 2 months ago

I post the successful experience of LM Studio here for others to reuse. Note: Since AutoDev currently only obtains content from the first message returned, SSE mode is not supported and "stream" in the body parameter should be set to false.

llm server: Custom
server: http://localhost:1234/v1/chat/completions
response(json path): $.choices[0].message.content
request body(json): {"customHeaders":{"Content-Type":"application/json"},"customFields":{"model":"lmstudio-community/Meta-Llama-3-8B-Instruct-GGUF","temperature":0.7,"max_tokens":-1,"stream":false}}
phodal commented 2 months ago

Already fix, after build finish you can download and test it: https://github.com/unit-mesh/auto-dev/actions/runs/9218399014

zanyatta commented 2 months ago

nice