When using the OpenAI format API request with the "anthropic/claude-3.5-sonnet" and many other models via the endpoint https://openrouter.ai/api/v1/chat/completions, the response completion is not generating properly. while other Chat UIs havn't had such an issue.
To Reproduce
Steps to reproduce the behavior:
Make an API request to the endpoint https://openrouter.ai/api/v1/chat/completions using the OpenAI standard format.
Use the model "anthropic/claude-3.5-sonnet".
Example prompt:
System: You are Claude, a large language model trained by Anthropic. Carefully heed the user's instructions. Respond very concise.
User: loop from 1 to 100 in python
Observe the response.
Expected behavior
The response should generate a concise and correct Python loop for iterating from 1 to 100.
Actual behavior
The response is incorrect and incomplete. Example response:
When using the OpenAI format API request with the "anthropic/claude-3.5-sonnet" and many other models via the endpoint
https://openrouter.ai/api/v1/chat/completions, the response completion is not generating properly. while other Chat UIs havn't had such an issue.To Reproduce Steps to reproduce the behavior:
https://openrouter.ai/api/v1/chat/completionsusing the OpenAI standard format.You are Claude, a large language model trained by Anthropic. Carefully heed the user's instructions. Respond very concise.loop from 1 to 100 in pythonExpected behavior The response should generate a concise and correct Python loop for iterating from 1 to 100.
Actual behavior The response is incorrect and incomplete. Example response: