Describe the bug
"Qwen/Qwen1.5-72B-Chat" does not support parameter n and returns multiple results at the same time, even if I set the parameter temperature
To Reproduce
Steps to reproduce the behavior:
'''
import os
from together import Together
response = client.chat.completions.create(
model="Qwen/Qwen1.5-72B-Chat",
messages=[{"role": "user", "content": "tell me about new york"}],
temperature=0.9,
n=3
)
print(response)
print(response.choices[0].message.content)
'''
Expected behavior
Return multiple results at the same time
Describe the bug "Qwen/Qwen1.5-72B-Chat" does not support parameter n and returns multiple results at the same time, even if I set the parameter temperature
To Reproduce Steps to reproduce the behavior: ''' import os from together import Together
client = Together(api_key=os.environ.get("TOGETHER_API_KEY"))
response = client.chat.completions.create( model="Qwen/Qwen1.5-72B-Chat", messages=[{"role": "user", "content": "tell me about new york"}], temperature=0.9, n=3 ) print(response) print(response.choices[0].message.content) ''' Expected behavior Return multiple results at the same time