dusty-nv / jetson-containers

Machine Learning Containers for NVIDIA Jetson and JetPack-L4T
MIT License
2.37k stars 482 forks source link

"sources/empty.tar.gz" file does not exist when building tensorrt_llm #698

Closed Guan-JW closed 4 weeks ago

Guan-JW commented 1 month ago

Hi,

I'm trying to build tensorrt_llm on my Jetson AGX Orin running JetPack 6.0. During the container build process (tensorrt_llm:r36.3.0-tensorrt_llm), I encountered the following error:

Step 6/9 : COPY ${TRT_LLM_SOURCE} ${SOURCE_TAR}
COPY failed: file not found in build context or excluded by .dockerignore: stat sources/empty.tar.gz: file does not exist

I checked the file jetson-containers/packages/llm/tensorrt_llm/config.py, which shows that the build process invokes the tensorrt_llm function like this: tensorrt_llm('0.5', patch='patches/0.5.diff', requires=['==r36.*', '==cu122'], default=True).

Then, within the tensort_llm function, it assigns src to 'source/empty.tar.gz', but this file seems to be missing from the repository.

Could you please assist in resolving this issue?

Thank you.

Guan-JW commented 1 month ago

Does this mean I need to manually download the 0.5.0 release into the source/ directory from here: https://github.com/NVIDIA/TensorRT-LLM/releases/tag/v0.5.0?