langgenius / dify

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.
https://dify.ai
Other
52.58k stars 7.69k forks source link

Multiple Prompts Testing #9700

Open mkeari opened 1 month ago

mkeari commented 1 month ago

Self Checks

1. Is this request related to a challenge you're experiencing? Tell me about your story.

While developing a new workflow we frequently experiment with the system prompts. Chaning them sometimes improves the results but other times you might want to get back to the previous one. In some cases it is beneficial to have multiple runs with outputs side-by-side for comparison. And keeping track of each of them in a separate notetaking app is frustrating.

Therefore, is it possible to add support for 2 (or more) different versions of system prompt running simultaneously? With side-by-side display of their outputs (similar to ChatGPT's suggested 2 versions). Maybe a special mode or button near the "Preview".

2. Additional context or comments

No response

3. Can you help us with this feature?

mkeari commented 1 month ago

I just realized that Dify has something similar but for models comparison ("Debug as Multiple Models"). But now it would be great to have the analog for prompts, and preferably not only in basic chatbot but chatflow as well

nickjfrench commented 3 weeks ago

I mentioned a similar request in #9055 but about Debug as Multiple Models in Workflow/Chatflow mode. Having multiple prompts testing and multiple models testing would help a great load in early development.