search

langchain-ai / langchainjs

🦜🔗 Build context-aware reasoning applications 🦜🔗
https://js.langchain.com/docs/
MIT License
11.79k stars 1.97k forks source link

Add support for Vertex AI Model Garden / Custom Models #2562

Open afirstenberg opened 10 months ago

afirstenberg commented 10 months ago

See langchain-ai/langchain#8850 and langchain-ai/langchain#9367 and will talk to @lkuligin about their implementation.

The general idea will be to provide a standard way to either access instances of these models at a designated endpoint directly, or create a subclass that can do so. (The request and response format have a standard, but it is a vague standard in some places.)

jacoblee93 commented 10 months ago

Would be great - I think this would likely look similar to SageMaker with an adapter class for different models?

https://github.com/langchain-ai/langchainjs/blob/main/langchain/src/llms/sagemaker_endpoint.ts#L35

afirstenberg commented 10 months ago

Yup, that's along the lines of what I was thinking (possibly with some specific subclasses for popular or well-advertised models).

dosubot[bot] commented 7 months ago

Hi, @afirstenberg,

I'm helping the langchainjs team manage their backlog and am marking this issue as stale. From what I understand, the issue was opened to add support for Vertex AI Model Garden and Custom Models, with discussions around establishing a standard method for accessing these models at a designated endpoint or creating a subclass to do so. The request and response format have a standard, but there are some vague areas. You and @jacoblee93 have discussed potential approaches, including using an adapter class for different models and specific subclasses for popular or well-advertised models.

Could you please confirm if this issue is still relevant to the latest version of the langchainjs repository? If it is, please let the langchainjs team know by commenting on the issue. Otherwise, feel free to close the issue yourself, or it will be automatically closed in 7 days. Thank you!

afirstenberg commented 7 months ago

This should be left open. The issue is still valid and we'll be evaluating the state of things once we see what changes Gemini brings.

dosubot[bot] commented 6 months ago

@jacoblee93, could you please assist with evaluating the state of the issue related to adding support for Vertex AI Model Garden and Custom Models in langchainjs? The user has indicated that the issue is still valid and will be re-evaluated after the changes brought by Gemini. Thank you!

AInoob commented 6 months ago

Hi @afirstenberg, Gemini API is out, any estimate on when langchainjs will support Gemini?

afirstenberg commented 6 months ago

Hi @afirstenberg, Gemini API is out, any estimate on when langchainjs will support Gemini?

3621 Added integration for the Google AI Studio version of Gemini and that will be in the next release. (Thanks to @alx13 for that work!)

We're currently discussing the best way to implement it for Vertex AI. If I'm working on it, It'll be this weekend.

dosubot[bot] commented 3 months ago

Hi, @afirstenberg,

I'm helping the langchainjs team manage their backlog and am marking this issue as stale. From what I understand, the issue you opened requests support for Vertex AI Model Garden and Custom Models in the langchainjs repository. Discussions have been ongoing about establishing a standard method for accessing these models at a designated endpoint or creating a subclass to do so. The issue is still relevant, and the team plans to evaluate it after the changes brought by Gemini. Additionally, integration for the Google AI Studio version of Gemini has been added, and discussions are ongoing for implementing it for Vertex AI.

Could you please confirm if this issue is still relevant to the latest version of the langchainjs repository? If it is, please let the langchainjs team know by commenting on the issue. Otherwise, feel free to close the issue yourself, or it will be automatically closed in 7 days. Thank you!

afirstenberg commented 3 months ago

This is still active - specifically targeting the models in Vertex AI Model Garden.