Convert cuda env tgi variables to lmi

deepjavalibrary / djl-serving

A universal scalable machine learning model deployment solution

Apache License 2.0

183 stars 58 forks source link

Closed sindhuvahinis closed 1 month ago

sindhuvahinis commented 1 month ago

Translating some of the cuda env variables to LMI format.

Testing: Bashed into a container and tested this bash script. bash /usr/local/bin/dockerd-entrypoint.sh serve