langgenius / dify

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.
https://dify.ai
Other
51.81k stars 7.51k forks source link

Need to add a prefix (passage) for embedding model (NIM) #8807

Closed lschaupp closed 5 days ago

lschaupp commented 1 month ago

Self Checks

Dify version

0.8.3

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

Deploy NIM as a container with a embedding model Setup Dify -> NIM requires "passage" variable as part of the query

✔️ Expected Behavior

The embedding model API works

❌ Actual Behavior

No response

crazywoola commented 1 month ago

What's the error message?

I think this #8785 might be a fix, but I am not sure based on the limited information. Please provide more helpful details.

lschaupp commented 1 month ago

More information:

Dify needs to implement a filed to customize the request that is being made to the custom endpoint.