add aws marketplace notebooks for LLama 8b, 70B, mixtral and nemotron 15B NIM

NVIDIA / nim-deploy

A collection of YAML files, Helm Charts, Operator code, and guides to act as an example reference implementation for NVIDIA NIM deployment.

https://build.nvidia.com/

Apache License 2.0

141 stars 64 forks source link

Closed kshitizgupta21 closed 1 week ago

kshitizgupta21 commented 1 week ago

This PR adds sample jupyter notebooks showing how to deploy LLama 3.1 8B, 70B, Mixtral 8x7B and Nemotron-4 15B NIMs from AWS Marketplace on SageMaker

kshitizgupta21 commented 1 week ago

cc: @JamesMaki @abhisheksawarkar