IBM / ibm-generative-ai

IBM-Generative-AI is a Python library built on IBM's large language model REST interface to seamlessly integrate and extend this service in Python programs.
https://ibm.github.io/ibm-generative-ai/
Apache License 2.0
245 stars 101 forks source link

Enhance Langchain LLM support - include WatsonX/BAM support #215

Closed dove-young closed 10 months ago

dove-young commented 10 months ago

Context

What are you trying to do and how would you want to do it differently? Is it something you currently you cannot do? Is this related to an issue/problem?

It is not able to run langchain use cases via WatsonX/BAM models so far.

like https://python.langchain.com/docs/use_cases/question_answering and https://python.langchain.com/docs/use_cases/question_answering/code_understanding

just for examples.

Alternatives

Can you achieve the same result doing it in an alternative way? Is the alternative considerable?

No, there is not an alternative way. LangChainInterface does not solve this problem as far as I know.

But there is a PR about add WatsonX support in langchain repo https://github.com/langchain-ai/langchain/pull/10238

This PR was pending on some problems and was been inactive for nearly 2 months.

Maybe it would be much quicker to enchance langchain support in IBM generative ai side.

Has the feature been requested before?

No. I don't find it from neither issue list nor bam-feedback channel.

Please provide a link to the issue.

If the feature request is approved, would you be willing to submit a PR?

Yes

LukaszCmielowski commented 10 months ago

Please hold on with any work related to adding support for watsonx.ai via BAM. There is a work in progress to use watsonx.ai official SDK and the PR will be opened soon. We should not be using the tech preview content as a base for Langchain integration. As soon the PR is open I will share the link.

Tomas2D commented 10 months ago

https://github.com/langchain-ai/langchain/pull/12544