search

langchain-ai / langchain

🦜🔗 Build context-aware reasoning applications
https://python.langchain.com
MIT License
91.2k stars 14.49k forks source link

langchain callback support PALM2 GCP #5904

Closed bhanu-Bigdata closed 6 months ago

bhanu-Bigdata commented 1 year ago

Feature request

As of now callbacks are provisioned for OPEN AI which gives completion tokens, prompt tokens and total cost. Similar feature is needed for VertexAI Chat Models of GCP.

Motivation

This is an important feature as this abstraction is needed for GCP

Your contribution

i can test and validate

dhanashri3107 commented 1 year ago

I am also facing the same issue. Please let me know

ktibbs9417 commented 10 months ago

Would also love to have this feature

dosubot[bot] commented 6 months ago

Hi, @bhanu-Bigdata,

I'm helping the LangChain team manage their backlog and am marking this issue as stale. From what I understand, you requested support for callbacks for VertexAI Chat Models of GCP in the langchain project, similar to the provision for OPEN AI. You emphasized the importance of this feature for GCP and offered to test and validate the implementation. Other users, including @dhanashri3107 and @ktibbs9417, have expressed interest and support for this feature in the comments.

Could you please confirm if this issue is still relevant to the latest version of the LangChain repository? If it is, please let the LangChain team know by commenting on the issue. Otherwise, feel free to close the issue yourself, or the issue will be automatically closed in 7 days.

Thank you!

dosubot[bot] commented 6 months ago

Hi, @bhanu-Bigdata,

I'm helping the LangChain team manage their backlog and am marking this issue as stale. From what I understand, you requested support for callbacks for VertexAI Chat Models of GCP in the langchain project, similar to the provision for OPEN AI. You emphasized the importance of this feature for GCP and offered to test and validate the implementation. Other users, including @dhanashri3107 and @ktibbs9417, have expressed interest and support for this feature in the comments.

Could you please confirm if this issue is still relevant to the latest version of the LangChain repository? If it is, please let the LangChain team know by commenting on the issue. Otherwise, feel free to close the issue yourself, or the issue will be automatically closed in 7 days.

Thank you!

bpafoshizle commented 6 months ago

Would be good to have this as a general vertex API model feature, not just palm.