search

langchain-ai / langchain-nvidia

MIT License
48 stars 15 forks source link

vanity model name support #35

Closed mattf closed 4 months ago

mattf commented 4 months ago

model names are currently things like playground_llama2-70b or ai-llama3-70b, these are not the proper names for the models. ai-llama3-70b is the name of a cloud function that serves the meta/llama3-70b-instruct model.

with this change the proper model names can be used along side the function name, for compatibility.

llm = ChatNVIDIA(model="ai-llama3-70b")

is equivalent to

llm = ChatNVIDIA(model="meta/llama3-70b-instruct")