search

Azure / azure-sdk-for-java

This repository is for active development of the Azure SDK for Java. For consumers of the SDK we recommend visiting our public developer docs at https://docs.microsoft.com/java/azure/ or our versioned developer docs at https://azure.github.io/azure-sdk-for-java.
MIT License
2.35k stars 1.98k forks source link

azure gpt stream is very slow #38092

Closed ZuoYouLai closed 9 months ago

ZuoYouLai commented 10 months ago

The response of azure gpt stream is very slow and cannot be as smooth as opeanai's chagpt. I have applied to pass the filtering of sensitive words, but the effect is still very poor;

specific parameters: topP = 0.95 temperature = 0.75 stream = true

joshfree commented 10 months ago

@mssfang can you please follow up with @ZuoYouLai for more details? @ZuoYouLai if there are more specific details you can share that would be helpful.

mssfang commented 10 months ago

@ZuoYouLai Thank you for contacting us. Can you provide a sample that I can reproduce it?

github-actions[bot] commented 9 months ago

Hi @ZuoYouLai. Thank you for opening this issue and giving us the opportunity to assist. To help our team better understand your issue and the details of your scenario please provide a response to the question asked above or the information requested above. This will help us more accurately address your issue.

github-actions[bot] commented 9 months ago

Hi @ZuoYouLai, we're sending this friendly reminder because we haven't heard back from you in 7 days. We need more information about this issue to help address it. Please be sure to give us your input. If we don't hear back from you within 14 days of this comment the issue will be automatically closed. Thank you!