Closed efung closed 3 weeks ago
Two thoughts on how to solve this:
Purely on the UI side, have a way to select existing evals to include in the view, or
I like this UI solution for the use case of multiple collaborators running their own evals, then wanting to do comparisons among the eval runs.
Merging evals together might have its own use cases, but I think would be cumbersome for browsing.
"Compare evals" functionality landed in the UI under Table Settings
In the config, if I've defined two prompts, or two providers, I see the side-by-side results in the Web UI.
What about the situation if I or someone else have run an eval on a single prompt or provider, and want to combine our two results and see them in the promptfoo Web UI? Can that be done?