An end-to-end sample of RAG showcasing development, evaluation, experimentation, and deployment using Promptflow, search products like CosmosDB, PostgresSQL, and Azure AI Search
MIT License
42
stars
8
forks
source link
python test client for with promptflow serving #37
Providing a test script as a client for working with promptflow serving endpoint. Follow the README in deployment_utilities/test_client to basically run the two test files named test_client.py and test_client_stream.py. You may deploy your own endpoint or you can use
It is deployed with rag-azure-search without streaming. For streaming, you will want to follow instructions in README and deploy to test the script. (I got it to render streaming in the console btw!)
Type of change
Please remove options that are not relevant.
[X] New feature: not breaking, new functionality
[ ] New feature: may cause existing code to not work as expected
[ ] Bug fix
[ ] Needs documentation update
Test and checks
Please describe how you've tested your file
[ ] tested via a notebook
[X] tested via a testflow
[ ] only made sure the code is written correctly
Checks
[X] commented code for complex areas
[X] updated readme with the new changes
[X] changes not generating errors with the main flows in rag-vectorsearchtype directories (e.g rag-cosmos-mongo)
[X] I have tested my implementation
[X] I have updated environment.yaml file with any additional dependancies
Description
Providing a test script as a client for working with promptflow serving endpoint. Follow the README in
deployment_utilities/test_clientto basically run the two test files namedtest_client.pyandtest_client_stream.py. You may deploy your own endpoint or you can usehttps://appliedai-chatbot-webapp.azurewebsites.net/score
It is deployed with rag-azure-search without streaming. For streaming, you will want to follow instructions in README and deploy to test the script. (I got it to render streaming in the console btw!)
Type of change
Please remove options that are not relevant.
Test and checks
Please describe how you've tested your file