awslabs / llm-hosting-container

Large Language Model Hosting Container
Apache License 2.0
75 stars 32 forks source link

chore: cover Nvidia T4/L4 GPUs #80

Closed haixiw closed 4 months ago

haixiw commented 4 months ago

Issue #, if available:

Description of changes:

Instance list from hosting: ml.p2., ml.p3., ml.p4d., ml.p4de., ml.g4dn., ml.g5. ml.p5., ml.g6.

Add missing GPU types based on https://developer.nvidia.com/cuda-gpus

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.