langchain-ai / langchain-nvidia

MIT License
48 stars 15 forks source link

update to 0.1, remove deprecated functionality and focus on api catalog backend #48

Closed mattf closed 3 months ago

mattf commented 3 months ago

this is version 0.1.0 of the connectors with two primary changes -

  1. [user visible] deprecated or unavailable functionality removed
  2. [not use visible] use of api catalog (integrate.api.nvidia.com and ai.api.nvidia.com) instead of nvcf (api.nvcf.nvidia.com) for inference

all playground_* model endpoints have been decommissioned.

functionality removed -

functionality deprecated -

migration guide -

model migration, the following models will raise a warning and use an alternative (model changes in italics) -

model alternative
_playground_llama213b meta/llama2-70b
_playground_llama2_code13b meta/codellama-70b
_playground_llama2_code34b meta/codellama-70b
_playground_nv_llama2_rlhf70b meta/llama2-70b
_playgroundphi2 microsoft/phi-3-mini-4k-instruct
playground_llama2_code_70b meta/codellama-70b
playground_gemma_2b google/gemma-2b
playground_gemma_7b google/gemma-7b
playground_llama2_70b meta/llama2-70b
playground_mistral_7b mistralai/mistral-7b-instruct-v0.2
playground_mixtral_8x7b mistralai/mixtral-8x7b-instruct-v0.1
playground_deplot google/deplot
playground_fuyu_8b adept/fuyu-8b
playground_kosmos_2 microsoft/kosmos-2
playground_neva_22b nvidia/neva-22b
_playground_nvolveqa40k NV-Embed-QA