Support llama-3.1 models

lakshaybhushan / nextjs-nvidia-chatbot

An open-source AI chatbot app template built with Next.js, the Vercel AI SDK and the newly released NVIDIA NIM API Inference.

https://nvidia-nim.vercel.app

1 stars 0 forks source link

Open xell opened 1 month ago

xell commented 1 month ago

Nvidia now offers llama-3.1 models for example https://build.nvidia.com/meta/llama-3_1-405b-instruct in the same api system. Is it possible to support them? Thanks.

lakshaybhushan commented 2 weeks ago

Hey @xell, I've tried integrating them, but right now they're just not working