search

microsoft / promptflow

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.
https://microsoft.github.io/promptflow/
MIT License
9.55k stars 872 forks source link

[Feature Request] Allow a run to be done on a subset of the dataset #3798

Open jomalsan opened 1 month ago

jomalsan commented 1 month ago

Is your feature request related to a problem? Please describe. When developing a flow, I often want to run the flow multiple times to see how my code is behaving. I usually only want 3-5 points to give me an idea of how its working, without running the full dataset through.

Describe the solution you'd like I want the ability to specify the number of data points from the dataset to run through the flow. I'd like this implemented as either:

Describe alternatives you've considered My current work around is to create a copy of my dataset that contains only a few data points. Then I use that dataset for my testing. But then I have two datasets to manage that may become out of sync.

github-actions[bot] commented 2 weeks ago

Hi, we're sending this friendly reminder because we haven't heard back from you in 30 days. We need more information about this issue to help address it. Please be sure to give us your input. If we don't hear back from you within 7 days of this comment, the issue will be automatically closed. Thank you!

jomalsan commented 2 weeks ago

bump