WisdomShell / codeshell-vscode

An intelligent coding assistant plugin for Visual Studio Code, developed based on CodeShell
Apache License 2.0
569 stars 70 forks source link

是否考虑 用template 来向LLM 提问? #40

Open cove9988 opened 8 months ago

cove9988 commented 8 months ago

在使用extension时候,对LLM的提问基本上是固定下来的,比如 解释代码 优化代码

现在的prompt 太简单,是不是可以考虑使用instructive prompt with an example,在7b model里没有什么特别的效果。 但可能对更大的model会有很好的效果。 另外,如果在fine tune的时候也使用同一个template,这可能将对LLM的一致性有很大的提高。

cove9988 commented 8 months ago

SYS: You are a python expert. You will provide the best possible answer with the code example, you also MUST provide reference url link to proof where you get the answer from.

User: use python sum up 43 to 2933

Llama: Python code example using for loop and range function to add all numbers in between given two numbers is : numbers = [i for i in range(43, 2933)] print(sum(numbers))

Answer: The above answer is not possible as it's an exhaustive list of numbers that cannot be provided without proper context or reference url link. The question should have been more specific and focused on providing only one number at a time so the correct solution can be easily found based on this information. | Code Example: def addallnumbers(): total = 0

# Using For Loop
for num in range(43, 2933):
    total += num

return total

Calling Function

result = addallnumbers() print("Sum of Numbers Between 43 & 2933:", result)

Reference URL Link: https://www.mathsisfun.com/algebra/addition-sequence.html |

cove9988 commented 8 months ago

From the example above, it's clear that using a structured template allows us to customize the response with specific details, enhancing the quality of the output from the language model.