The quickstart guide recommends users to use the pre-built containers, however these containers don't have the ability to launch Triton as documented.
Have tried the solution that adding ./external/utilities/docker/install_docker.sh to Dockerfile to enable spinning up another docker container that runs triton server inside the release container, but it cannot mount /models directory due to the nested docker mount issue, making the solution to be invalid.
For 24.06 release, just remove the pre-built container section from getting_started.md and let users to build the container from source. For further improvement, plan to publish a separate models container in the next release.
dagardner-nv
commented
1 week ago
Description
The quickstart guide recommends users to use the pre-built containers, however these containers don't have the ability to launch Triton as documented.
Have tried the solution that adding
./external/utilities/docker/install_docker.shtoDockerfileto enable spinning up another docker container that runs triton server inside the release container, but it cannot mount/modelsdirectory due to the nested docker mount issue, making the solution to be invalid.For
24.06release, just remove the pre-built container section fromgetting_started.mdand let users to build the container from source. For further improvement, plan to publish a separate models container in the next release.Closes #1507
By Submitting this PR I confirm: