search

microsoft / promptflow

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
https://microsoft.github.io/promptflow/
MIT License
9.56k stars 874 forks source link

[Feature Request] Allow the data parameter of evaluate to take a list #3207

Open pamelafox opened 6 months ago

pamelafox commented 6 months ago

The data parameter of evaluate currently only accepts a string that is a path to a JSONL file. It'd be more flexible if it accepted a list of dicts, like it used to when it was in azure-ai-generative SDK.

D-W- commented 6 months ago

Hi @pamelafox , thanks for the feedback. We'll support this after BUILD. I'll update here once supported.

github-actions[bot] commented 5 months ago

Hi, we're sending this friendly reminder because we haven't heard back from you in 30 days. We need more information about this issue to help address it. Please be sure to give us your input. If we don't hear back from you within 7 days of this comment, the issue will be automatically closed. Thank you!

pamelafox commented 5 months ago

No updates needed from me.

github-actions[bot] commented 4 months ago

Hi, we're sending this friendly reminder because we haven't heard back from you in 30 days. We need more information about this issue to help address it. Please be sure to give us your input. If we don't hear back from you within 7 days of this comment, the issue will be automatically closed. Thank you!