search

NVIDIA / nim-deploy

A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deployment.
https://build.nvidia.com/
Apache License 2.0
141 stars 64 forks source link

List of Nvidia Nim available/released LLM Models #34

Closed nskumz closed 4 months ago

nskumz commented 4 months ago

could you please list out the available nvidia nim LLM model images as of now. so that we can work around those models apart form these two

  1. meta-llama/Meta-Llama-3-70B-Instruct
  2. meta-llama/Meta-Llama-3-8B-Instruct
supertetelman commented 4 months ago

A full list of supported LLM NIM models can be found here: https://docs.nvidia.com/nim/large-language-models/latest/support-matrix.html#supported-models

Additional NIM models for things like reranking and embedding can also be found on the nvidia docs page and on https://build.nvidia.com/.

The current list:

Llama 3.1 8B Base Llama 3.1 8B Instruct Llama 3.1 70B Instruct Meta-Llama-3-8B-Instruct Meta-Llama-3-70B-Instruct Mistral-7B-Instruct-v0.3 Mixtral-8x7B-v0.1 Mixtral-8x22B-v0.1