Azure-Samples / chat-with-your-data-solution-accelerator

A Solution Accelerator for the RAG pattern running in Azure, using Azure AI Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences. This includes most common requirements and best practices.
https://azure.microsoft.com/products/search
MIT License
776 stars 393 forks source link

Updating .env and Changing Model Configurations #1306

Open DSOTM-RSA opened 6 days ago

DSOTM-RSA commented 6 days ago

Describe the bug

Having succesfully deployed the solution via Local Development/Deployment I would like to change my .env to reflect am alternate configruation, i.e. GPT3.5 to GPT4o for example. Adjusting the .env as needed, I receive the following error.

image

It seems like I can't update the open-ai service to use an alternative (chat) model.

Expected behavior

The ability to change .env to deploy new models, or use existing models (in the same azure-openai instance) for previously deployed azd environments. [I've done this many times for the alternative ChatGPT + Enterprise data with Azure OpenAI and AI Search demo successfully]

How can I change, configure my deplyoments to meet/match the case as presented in the contract existence example, or in any custom configuration of my choice, gpt4-o and embedding-small etc.

Am I missing something fundamentally different about how these two solutions use azd, change existing/create new enviornments or use existing resources??

Debugging information

Windows 10 >> WSL >> Dev Container RG = swedencentral

Steps to reproduce

Steps to reproduce the behavior:

  1. Go to '...'
  2. Click on '....'
  3. Scroll down to '....'
  4. See error

Screenshots

If applicable, add screenshots to help explain your problem.

Logs

If applicable, add logs to help the engineer debug the problem.


Tasks

To be filled in by the engineer picking up the issue

Roopan-Microsoft commented 4 days ago

Hey @DSOTM-RSA , Thanks for your feedback. If you want to update the GPT Model. You have 2 options.

I’ll provide you with the details soon.

Thank you for your patience; it’s greatly appreciated.

Roopan-Microsoft commented 2 days ago

Hey @DSOTM-RSA - We figured out the issue that few of the env variables are not getting populated in .env file.

We are currently working on that. Will keep you posted. Thanks