search

microsoft / azurechat

🤖 💼 Azure Chat Solution Accelerator powered by Azure Open AI Service
MIT License
1.19k stars 1.12k forks source link

using gpt4 #360

Closed emmae157 closed 2 weeks ago

emmae157 commented 6 months ago

hi,

I've deployed the app in azure and when running the app, I noticed it uses gpt4 1106-preview for only text inputs and uses gpt4 vision-preview for only visual inputs. Why would it be running this way as I thought gpt4 vision-preview can take text inputs?

Also, is the chat response quite slow for anyone? When I send "hi", it takes about 3-5 seconds to respond. When it's a short paragraph, about 14-26 seconds. Long paragraphs, up to a minute

thanks

mkandukuri4 commented 6 months ago

Hi @emmae157,

Yes, I have also faced a lot of latency issues when the GPT version is 1106-preview, if you switch to the GA version of GPTs (GPT-35) there are low latency issues.

emmae157 commented 6 months ago

hi @mkandukuri4, thanks for your response, I'll try that

sonphnt commented 5 months ago

Yes, I have the same issue. There is an issue with GPT4-1106 preview. So we might have to wait for Microsoft to release final version.

davidxw commented 2 weeks ago

Solution has been updated to support new gpt-4o model. Note that given the speed at which new models and versions of models are released this repo might always be a little behind!