search

microsoft / PubSec-Info-Assistant

Information Assistant, built with Azure OpenAI Service, Industry Accelerator
MIT License
336 stars 730 forks source link

Inconsistency in answers #799

Open reshma67 opened 3 months ago

reshma67 commented 3 months ago

What is the cause of getting inconsistent answers with respect to mathematical formula and sometimes not parsing the markdown format

Example variance calculation, Median calculation

dayland commented 2 months ago

@reshma67, can you please provide some specific examples of where you are seeing inconsistencies? These are "preview" features and are not expected to be perfect in the current release.

reshma67 commented 2 months ago

@dayland i added two pdf files and tried read retrieval method which answers based on the content , and i asked the same question twice and the second time the explanation was much lesser compared to the first response

dayland commented 1 month ago

The very nature of generative AI is that you will not always get the exact same answer. The answer should be grounded in the same facts, but the verbosity and detail of the answers will vary. It is not the same as Enterprise Search where the same result is returned each time.

dayland commented 1 month ago

This issue is marked for closure due to inactivity for 2 weeks. It will be closed in 5 days.