bug: fail to build llama-3-8b-instruct-trt-llm

[zhyncs]

As titled. And due to billing reasons, I have currently deleted this model. Here is the reproduction method and error log. From the log, it can be seen that it should be a permission issue. Have you run this model successfully in the truss workspace before? Thanks. cc @pankajroark @philipkiely-baseten

how to reproduce it

git clone https://github.com/basetenlabs/truss-examples
cd truss-examples/llama/llama-3-8b-instruct-trt-llm
truss push --trusted

error log

Sep 11 01:24:21am
#54 [truss_server 30/33] COPY ./control /control
Sep 11 01:24:21am
#54 CACHED
Sep 11 01:24:21am
Sep 11 01:24:21am
#55 [truss_server 31/33] RUN python3 -m venv /control/.env     && /control/.env/bin/pip3 install -r /control/requirements.txt
Sep 11 01:24:21am
#55 0.094 The virtual environment was not created successfully because ensurepip is not
Sep 11 01:24:21am
#55 0.094 available.  On Debian/Ubuntu systems, you need to install the python3-venv
Sep 11 01:24:21am
#55 0.094 package using the following command.
Sep 11 01:24:21am
#55 0.094 
Sep 11 01:24:21am
#55 0.094     apt install python3.10-venv
Sep 11 01:24:21am
#55 0.094 
Sep 11 01:24:21am
#55 0.094 You may need to use sudo with that command.  After installing the python3-venv
Sep 11 01:24:21am
#55 0.094 package, recreate your virtual environment.
Sep 11 01:24:21am
#55 0.094 
Sep 11 01:24:21am
#55 0.094 Failing command: /control/.env/bin/python3
Sep 11 01:24:21am
#55 0.094 
Sep 11 01:24:21am
#55 ERROR: process "/bin/sh -c python3 -m venv /control/.env     && /control/.env/bin/pip3 install -r /control/requirements.txt" did not complete successfully: exit code: 1
Sep 11 01:24:21am
------
Sep 11 01:24:21am
 > [truss_server 31/33] RUN python3 -m venv /control/.env     && /control/.env/bin/pip3 install -r /control/requirements.txt:
Sep 11 01:24:21am
0.094 available.  On Debian/Ubuntu systems, you need to install the python3-venv
Sep 11 01:24:21am
0.094 package using the following command.
Sep 11 01:24:21am
0.094 
Sep 11 01:24:21am
0.094     apt install python3.10-venv
Sep 11 01:24:21am
0.094 
Sep 11 01:24:21am
0.094 You may need to use sudo with that command.  After installing the python3-venv
Sep 11 01:24:21am
0.094 package, recreate your virtual environment.
Sep 11 01:24:21am
0.094 
Sep 11 01:24:21am
0.094 Failing command: /control/.env/bin/python3
Sep 11 01:24:21am
0.094 
Sep 11 01:24:21am
------
Sep 11 01:24:21am
Dockerfile:143
Sep 11 01:24:21am
--------------------
Sep 11 01:24:21am
 142 |     COPY ./control /control
Sep 11 01:24:21am
 143 | >>> RUN python3 -m venv /control/.env \
Sep 11 01:24:21am
 144 | >>>     && /control/.env/bin/pip3 install -r /control/requirements.txt
Sep 11 01:24:21am
 145 |     COPY ./model /app/model
Sep 11 01:24:21am
--------------------
Sep 11 01:24:21am
error: failed to solve: process "/bin/sh -c python3 -m venv /control/.env     && /control/.env/bin/pip3 install -r /control/requirements.txt" did not complete successfully: exit code: 1
Sep 11 01:24:21am
2024/09/10 15:24:21 Skipping step because a previous step failed

[joostinyi]

Hi – this looks like a build failure for our hot reload servers. Please try to use this example to deploy a TRT-LLM deployment to your workspace

[zhyncs]

ok Thanks!

[zhyncs]

@joostinyi It works well for me. Thanks again!