Add user feedback in langfuse message trace

langgenius / dify

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

https://dify.ai

Other

53.73k stars 7.87k forks source link

Add user feedback in langfuse message trace #10434

Open wy96f opened 3 weeks ago

wy96f commented 3 weeks ago

Self Checks

[X] I have searched for existing issues search for existing issues, including closed ones.
[X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
[X] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
[X] Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

The operations team wants to view messages about users liking or disliking, incorporate them into the dataset for annotation, and optimize the overall application's response effectiveness.

2. Additional context or comments

No response

3. Can you help us with this feature?

[ ] I am interested in contributing to this feature.

ZhouhaoJiang commented 3 weeks ago

@wy96f Considering that we are currently supporting Langfuse and Langsmith, with plans to integrate more platforms in the future, our primary goal is to track and analyze model usage and consumption, such as token usage and performance metrics. This integration is intended to provide a better understanding of how the models are being used, rather than to support highly specialized or fine-tuned features. As such, we are not considering the integration of features like viewing specific user feedback (likes/dislikes) within the message trace at this time.

wy96f commented 3 weeks ago

@wy96f Considering that we are currently supporting Langfuse and Langsmith, with plans to integrate more platforms in the future, our primary goal is to track and analyze model usage and consumption, such as token usage and performance metrics. This integration is intended to provide a better understanding of how the models are being used, rather than to support highly specialized or fine-tuned features. As such, we are not considering the integration of features like viewing specific user feedback (likes/dislikes) within the message trace at this time.

@ZhouhaoJiang Got it, thanks for reply. Do you have plans to support phoenix(https://github.com/Arize-ai/phoenix)? It is also a popular open-source project that many people are using.