microsoft / promptflow-rag-project-template

An end-to-end sample of RAG showcasing development, evaluation, experimentation, and deployment using Promptflow, search products like CosmosDB, PostgresSQL, and Azure AI Search
MIT License
45 stars 10 forks source link

Add query rewriter and other improvements (rename question to query in eval dataset, minor changes to prompts & inputs) #44

Closed alsavelv closed 4 months ago

alsavelv commented 6 months ago

Description

Please include a summary of the change or issue fix.

Type of change

Please remove options that are not relevant.

Test and checks

Please describe how you've tested your file

journeyman-msft commented 4 months ago

I went ahead and ran the three samples in promptflow with the queryrewriter and they work, however, I tried running it in interactive mode with a follow up question "What organization were we talking about?" and i would get various failures in all three: 1) queryparser 2) chatflow 3) try to retrieve new index. Is this a question we want to have handled?

This question works however for all 3.

image