Use without Azure?

[marco2meyer]

Thank you so much for open-sourcing this repo, this is great!

I am trying to use the repo without Azure, but with no success yet. You note in the Readme that you ran the model on Azure. Have you tested whether the code runs if you set the Azure flag to false? I am getting somewhat inscrutable error messages from the open-ai API:

INFO:openai:error_code=None error_message='Invalid URL (POST /v1/engines/gpt4-32k/chat/completions)' error_param=None error_type=invalid_request_error message='OpenAI API error received' stream_error=False

[MikeWangWZHL]

Hi,

Thanks for the message. I guess one possible reason for causing this problem is that you might need to modify the engine name to fit your API deployment. e.g., modifying the MODEL variable in the .sh scripts, such as: https://github.com/MikeWangWZHL/Solo-Performance-Prompting/blob/e77d109f1c9a8498995a5592dc0a5ea744b4b0f8/scripts/trivia_creative_writing.sh#L2C14-L2C14

Please first make sure that you setup the configuration in: https://github.com/MikeWangWZHL/Solo-Performance-Prompting/blob/main/config_template.sh

And then use a valid engine/model name compatible with the API, for example, if you are using the OpenAI's official API then the model names here https://platform.openai.com/docs/models/gpt-4 would be some valid choices? (the one "gpt4-32k" ("devgpt4-32k") we are using is only for the Azure deployment that we are using)

So a possible quick fix might be: change the MODEL="gpt4-32k" to MODEL="gpt-4-32k"?

[marco2meyer]

Dear ——Hi,

Thank you so much for this – I had not looked at the task scripts yet. Also in the process of applying for GPT4 access on Azure – fingers crossed.

All best,

                Marco

Von: Zhenhailong Wang @.> Antworten an: MikeWangWZHL/Solo-Performance-Prompting @.> Datum: Donnerstag, 31. August 2023 um 18:02 An: MikeWangWZHL/Solo-Performance-Prompting @.> Cc: Marco Meyer @.>, Author @.***> Betreff: Re: [MikeWangWZHL/Solo-Performance-Prompting] Use without Azure? (Issue #2)

Hi,

Thanks for the message. I guess one possible reason for causing this problem is that you might need to modify the engine name to fit your API deployment. e.g., modifying the MODEL variable in the .sh scripts, such as: https://github.com/MikeWangWZHL/Solo-Performance-Prompting/blob/e77d109f1c9a8498995a5592dc0a5ea744b4b0f8/scripts/trivia_creative_writing.sh#L2C14-L2C14

Please first make sure that you setup the configuration in: https://github.com/MikeWangWZHL/Solo-Performance-Prompting/blob/main/config_template.sh

And then use a valid engine/model name compatible with the API, for example, if you are using the OpenAI's official API then the model names here https://platform.openai.com/docs/models/gpt-4 would be some valid choices? (the one gpt4-32k (devgpt4-32k) we are using is only for the Azure deployment that we are using)

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

[isongme]

Thank you for open sourcing this project! However, I have encountered some configuration issues while using Azure to call the OpenAI API. I have successfully applied for the Azure OpenAI Service and have deployed a model of gpt-35-turbo. I have made the following modifications to the config_template.sh and trivia_creative_writing.sh scripts.

I then tried to run them in the terminal using the commands source config_template.sh and bash scripts/trivia_creative_writing.sh, but encountered the following error message.

Could you please help me by guiding which step or information might be incorrect?Thanks very much!!!