search

langchain-ai / langchain-ibm

MIT License
10 stars 9 forks source link

Using llama-3.1-70B (langchain-ibm version==0.3.0) #30

Open shaigrt opened 3 weeks ago

shaigrt commented 3 weeks ago

Hi,

I tested the new langchain-ibm version, it works good for mistral-large.

However with llama-3.1-70B I got the following error: 

ibm_watsonx_ai.wml_client_error.ApiRequestFailure: Failure during generate. (POST https://us-south.ml.cloud.ibm.com/ml/v1/text/chat?version=2024-10-01)
Status code: 400, body: {"errors":[{"code":"model_no_support_for_function","message":"Model 'meta-llama/llama-3-1-70b-instruct' does not support function 'function_text_chat'","more_info":"https://cloud.ibm.com/apidocs/watsonx-ai"}],"trace":"99fd521a142a1beebb9cfa4f0fee61f5","status_code":400}

Is there a plan to support this model as well?

MateuszOssGit commented 3 weeks ago

Hi @shaigrt Yes, there is a plan to support model meta-llama/llama-3-1-70b-instruct as well in near future. Our backend service working on it. Right now we recommend using mistralai/mistral-large

alonh commented 2 days ago

hi @MateuszOssGit Is there an ETA for when additional models will be supported? Thanks.