Open mapa17 opened 1 year ago
I can report that changing the build-type
to Release results in an successful build.
python ./build.py --target-platform linux --target-machine x86_64 --build-type=Release --version 2.36.0 --enable-gpu --endpoint=grpc --endpoint=http --backend=pytorch
I can report that changing the
build-type
to Release results in an successful build.
I confirm this result, thanks @mapa17, but a successful compilation seems to be version-dependent and component-dependent, in my case (in latestml/ml-gpu-py311-cuda118-hf
containers used as the base image) it required also setting --version 2.36.0
or possibly later (earlier ones may still fail, e.g. --version 2.29.0
did despite --build-type=Release
) and also succeeded for the --backend=python
, but failed for for --backend=pytorch
, with an attempt to... pull a custom image containing PyTorch using docker (how was that nested docker pull supposed to work when building another docker image I cannot imagine - it would normally be done using the FROM directive from the Dockerfile rather than a CLI command docker pull
:)
More info:
[ 12%] Extracting pytorch and torchvision libraries and includes from nvcr.io/nvidia/pytorch:23.07-py3
cd /tmp/triton-build/pytorch/build/_deps/repo-common-build/src && /usr/bin/c++ -I/tmp/triton-build/pytorch/build/_deps/repo-common-src/src/../include -I/tmp/triton-build/pytorch/build/_deps/repo-common-src/src -O3 -DNDEBUG -fPIC -Wall -Wextra -Wno-unused-parameter -Wno-type-limits -Werror -MD -MT _deps/repo-common-build/src/CMakeFiles/triton-common-error.dir/error.cc.o -MF CMakeFiles/triton-common-error.dir/error.cc.o.d -o CMakeFiles/triton-common-error.dir/error.cc.o -c /tmp/triton-build/pytorch/build/_deps/repo-common-src/src/error.cc
/opt/conda/lib/python3.11/site-packages/cmake/data/bin/cmake -E make_directory include/torchvision
[ 15%] Building CXX object _deps/repo-common-build/src/CMakeFiles/triton-common-logging.dir/logging.cc.o
[ 17%] Building CXX object _deps/repo-common-build/src/CMakeFiles/triton-common-async-work-queue.dir/async_work_queue.cc.o
cd /tmp/triton-build/pytorch/build/_deps/repo-common-build/src && /usr/bin/c++ -I/tmp/triton-build/pytorch/build/_deps/repo-common-src/src/../include -I/tmp/triton-build/pytorch/build/_deps/repo-common-src/src -O3 -DNDEBUG -fPIC -Wall -Wextra -Wno-unused-parameter -Wno-type-limits -Werror -MD -MT _deps/repo-common-build/src/CMakeFiles/triton-common-logging.dir/logging.cc.o -MF CMakeFiles/triton-common-logging.dir/logging.cc.o.d -o CMakeFiles/triton-common-logging.dir/logging.cc.o -c /tmp/triton-build/pytorch/build/_deps/repo-common-src/src/logging.cc
cd /tmp/triton-build/pytorch/build/_deps/repo-common-build/src && /usr/bin/c++ -I/tmp/triton-build/pytorch/build/_deps/repo-common-src/src/../include -I/tmp/triton-build/pytorch/build/_deps/repo-common-src/src -O3 -DNDEBUG -fPIC -Wall -Wextra -Wno-unused-parameter -Wno-type-limits -Werror -MD -MT _deps/repo-common-build/src/CMakeFiles/triton-common-async-work-queue.dir/async_work_queue.cc.o -MF CMakeFiles/triton-common-async-work-queue.dir/async_work_queue.cc.o.d -o CMakeFiles/triton-common-async-work-queue.dir/async_work_queue.cc.o -c /tmp/triton-build/pytorch/build/_deps/repo-common-src/src/async_work_queue.cc
[ 20%] Building CXX object _deps/repo-common-build/src/CMakeFiles/triton-common-table-printer.dir/table_printer.cc.o
cd /tmp/triton-build/pytorch/build/_deps/repo-common-build/src && /usr/bin/c++ -I/tmp/triton-build/pytorch/build/_deps/repo-common-src/src/../include -I/tmp/triton-build/pytorch/build/_deps/repo-common-src/src/src -O3 -DNDEBUG -fPIC -Wall -Wextra -Wno-unused-parameter -Wno-type-limits -Werror -MD -MT _deps/repo-common-build/src/CMakeFiles/triton-common-table-printer.dir/table_printer.cc.o -MF CMakeFiles/triton-common-table-printer.dir/table_printer.cc.o.d -o CMakeFiles/triton-common-table-printer.dir/table_printer.cc.o -c /tmp/triton-build/pytorch/build/_deps/repo-common-src/src/table_printer.cc
docker pull nvcr.io/nvidia/pytorch:23.07-py3
make[2]: docker: Permission denied
make[2]: *** [CMakeFiles/ptlib_target.dir/build.make:104: libc10.so] Error 127
make[2]: Leaving directory '/tmp/triton-build/pytorch/build'
make[1]: *** [CMakeFiles/Makefile2:248: CMakeFiles/ptlib_target.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....
[..]
make[1]: Leaving directory '/tmp/triton-build/pytorch/build'
make: *** [Makefile:136: all] Error 2
error: build failed
Description I am trying to build a triton docker image following the https://github.com/triton-inference-server/server/blob/r23.07/docs/customization_guide/build.md#building-with-docker
Using the build command
python ./build.py --target-platform linux --target-machine x86_64 --build-type=MinSizeRel --version 2.36.0 --enable-gpu --endpoint=grpc --endpoint=http --backend=pytorch
Building fails complaining about a
maybe-uniitialized
warning during linking. I think this could be related tot he issue: https://github.com/triton-inference-server/server/issues/5643Error
Triton Information What version of Triton are you using?
Are you using the Triton container or did you build it yourself?
To Reproduce Steps to reproduce the behavior.
python ./build.py --target-platform linux --target-machine x86_64 --build-type=MinSizeRel --version 2.36.0 --enable-gpu --endpoint=grpc --endpoint=http --backend=pytorch
Expected behavior No error during build. A docker image is created.