Closed deepakas closed 6 days ago
@deepakas Can you share the model version you used? This is usually cased by the use of preview OpenAI models.
Hi, we're sending this friendly reminder because we haven't heard back from you in 30 days. We need more information about this issue to help address it. Please be sure to give us your input. If we don't hear back from you within 7 days of this comment, the issue will be automatically closed. Thank you!
Fixed in 0.3.2 version.
Describe the bug Similarity Evaluator responds with a response Nan as first token in response is 'Text" and promptflow is not able to convert text to integer.
How To Reproduce the bug Steps to reproduce the behavior, how frequent can you experience the bug:
Expected behavior A clear and concise description of what you expected to happen.
It should respond with a number 1 to 5 as per the prompty - https://github.com/microsoft/promptflow/blob/main/src/promptflow-evals/promptflow/evals/evaluators/_similarity/similarity.prompty
Screenshots If applicable, add screenshots to help explain your problem.
Running Information(please complete the following information):
pf -v
: [e.g. 0.0.102309906] : { "promptflow": "1.12.0","promptflow-azure": "1.13.0", "promptflow-core": "1.12.0",
"promptflow-devkit": "1.12.0", "promptflow-evals": "0.3.0",
"promptflow-tracing": "1.12.0" }
python --version
: [e.g. python==3.10.12] Python (Windows) 3.11.9 (tags/v3.11.9:de54cf5, Apr 2 2024, 10:12:12) [MSC v.1938 64 bit (AMD64)]Additional context Add any other context about the problem here.