search

microsoft / promptflow

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
https://microsoft.github.io/promptflow/
MIT License
9.06k stars 817 forks source link

[Feature Request] Provide example of evaluator_config for evaluate #3203

Open pamelafox opened 3 months ago

pamelafox commented 3 months ago

I suspect that I need to specify evaluator_config for evaluate in order to map the data from the target response, but there's no example of it in the docstring or in https://pypi.org/project/promptflow-evals/0.2.0.dev0/

Can you provide an example either in the docstring or the promptflow-evals docs?

github-actions[bot] commented 2 months ago

Hi, we're sending this friendly reminder because we haven't heard back from you in 30 days. We need more information about this issue to help address it. Please be sure to give us your input. If we don't hear back from you within 7 days of this comment, the issue will be automatically closed. Thank you!

pamelafox commented 2 months ago

I don't believe any more input is needed from me. (The stalebot in this repo seems to be tuned to respond really quickly to perceived stalneness, btw).

github-actions[bot] commented 1 month ago

Hi, we're sending this friendly reminder because we haven't heard back from you in 30 days. We need more information about this issue to help address it. Please be sure to give us your input. If we don't hear back from you within 7 days of this comment, the issue will be automatically closed. Thank you!

luigiw commented 1 month ago

@diondrapeck , can you pick this up while you're working on docs improvement? Thank you.