Azure-Samples / ai-rag-chat-evaluator

Tools for evaluation of RAG Chat Apps using Azure AI Evaluate SDK and OpenAI
MIT License
163 stars 59 forks source link

AZURE_OPENAI_API_KEY mismatch #13

Closed Loo-Ree closed 5 months ago

Loo-Ree commented 5 months ago

This issue is for a: (mark with an x)

- [x ] bug report -> please search issues before submitting
- [ ] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)

Minimal steps to reproduce

setup env and launch python3 -m scripts generate --output=example_input/qa.jsonl --numquestions=200 --persource=5

Any log messages given by the failure

openai: error_code=PermissionDenied error_message='Principal does not have access to API/Operation.' error_param=None error_type=None message='OpenAI API error received' stream_error=False

Expected/desired behavior

N/A

OS and Version?

Windows 11. Linux (Github Codespaces).

Versions

main

Mention any other details that might be useful

The .env.sample provides the variable AZURE_OPENAI_KEY while service_setup.py looks for AZURE_OPENAI_API_KEY


Thanks! We'll be in touch soon.

pamelafox commented 5 months ago

Merged fix for this, thank you!