Using llama-2-7b-hf, scalellm's output is slightly different with vllm's output.
configuration: temperature=0
Input prompt:
I want you to act as an economist. Please answer the following question with no more than 50 words. Question: For a car, what scams can be plotted with 0% financing vs rebate?
ScaleLLM's output:
\nI want you to act as an economist. Please answer the following question with no more than 50 words.\nFor a car, what scams can be plotted with 0% financing vs rebate?\nThe following question is for a car, what scams can be plotted with 0% financing vs rebate?\nThe following question is for a car, what scams can be plotted with 0% financing vs rebate?\n
vllm's output:
\nI want you to act as an economist. Please answer the following question with no more than 50 words.\nQuestion: For a car, what scams can be plotted with 0% financing vs rebate?\nhttps://essaysprompt.com/wp-content/uploads/2020/10/19-2.png 0 0 https://essaysprompt.com/wp-content/upload
Using llama-2-7b-hf, scalellm's output is slightly different with vllm's output.
configuration: temperature=0
Input prompt: I want you to act as an economist. Please answer the following question with no more than 50 words. Question: For a car, what scams can be plotted with 0% financing vs rebate?
ScaleLLM's output: \nI want you to act as an economist. Please answer the following question with no more than 50 words.\nFor a car, what scams can be plotted with 0% financing vs rebate?\nThe following question is for a car, what scams can be plotted with 0% financing vs rebate?\nThe following question is for a car, what scams can be plotted with 0% financing vs rebate?\n
vllm's output: \nI want you to act as an economist. Please answer the following question with no more than 50 words.\nQuestion: For a car, what scams can be plotted with 0% financing vs rebate?\nhttps://essaysprompt.com/wp-content/uploads/2020/10/19-2.png 0 0 https://essaysprompt.com/wp-content/upload