togethercomputer / together-python

The Official Python Client for Together's API
https://pypi.org/project/together/
Apache License 2.0
21 stars 4 forks source link

"Qwen/Qwen1.5-72B-Chat" does not support parameter n and returns multiple results at the same time, even if I set the parameter temperature #128

Closed andy2332 closed 2 months ago

andy2332 commented 2 months ago

Describe the bug "Qwen/Qwen1.5-72B-Chat" does not support parameter n and returns multiple results at the same time, even if I set the parameter temperature

To Reproduce Steps to reproduce the behavior: ''' import os from together import Together

client = Together(api_key=os.environ.get("TOGETHER_API_KEY"))

response = client.chat.completions.create( model="Qwen/Qwen1.5-72B-Chat", messages=[{"role": "user", "content": "tell me about new york"}], temperature=0.9, n=3 ) print(response) print(response.choices[0].message.content) ''' Expected behavior Return multiple results at the same time

orangetin commented 2 months ago

this doesn't seem like an issue with the Python SDK, but rather with the API. Please open a ticket with support: https://www.together.ai/contact