SageMaker TGI DLC ENV vars

huggingface / notebooks

Notebooks using the Hugging Face libraries 🤗

Apache License 2.0

3.59k stars 1.51k forks source link

SageMaker TGI DLC ENV vars #382

Open austinmw opened 1 year ago

austinmw commented 1 year ago

Hi, is there documentation for the list of ENV vars available when deploying the TGI DLC container in SageMaker? For example, any others besides these? HF_MODEL_ID, SM_NUM_GPUS, HF_MODEL_QUANTIZE