search

triton-inference-server / fastertransformer_backend

BSD 3-Clause "New" or "Revised" License
411 stars 133 forks source link

Failing to build with triton 23.04 #150

Open bronzafa opened 1 year ago

bronzafa commented 1 year ago

Description

System H100 and L40, driver 530.30.02 and cuda 12.1

Build is failing with following error, no mather the branch used (main, v1.4, fix/multi_instance, etc..)

[ 54%] Built target online_softmax_beamsearch_kernels
make: *** [Makefile:136: all] Error 2
The command '/bin/sh -c make -j"$(grep -c ^processor /proc/cpuinfo)" install' returned a non-zero code: 2
error: docker build tritonserver_with_ft failed

a couple weeks ago I was able to build it without any problems but now is not working.

Reproduced Steps

install using python3 docker/create_dockerfile_and_build.py --triton-version 23.04
or 
docker build --rm   \
    --build-arg TRITON_VERSION=${CONTAINER_VERSION}   \
    -t ${TRITON_DOCKER_IMAGE} \
    -f docker/Dockerfile \
    .
show the same error
SeungjaeLim commented 1 year ago

How about try it in version 22.12? I had the same error as you, and I changed the version to 22.12, but it didn't fix the error.

bronzafa commented 1 year ago

with 22.12 the build worked, but in my case I need to use 23.04 for using Model Analyzer, since the 22.12 is much older and Model Analyzer is giving errors