search

triton-inference-server / fastertransformer_backend

BSD 3-Clause "New" or "Revised" License
411 stars 133 forks source link

FasterTransformer Backend fails to build using latest version of Triton Server #140

Open mshuffett opened 1 year ago

mshuffett commented 1 year ago

Description

The Docker built fine using the older version mentioned in readme (22.12), but when trying to build using the latest docker (23.05) it fails.

See this log file: https://gist.github.com/mshuffett/dc9e36921de15f9a9e5bc81b097430d8

Reproduced Steps

`python docker/create_dockerfile_and_build.py --triton-version 23.05`
mshuffett commented 1 year ago

Confirmed that this was a regression specifically with 23.05 -- 23.04 builds successfully.

YooSungHyun commented 1 year ago

me too... and if i using 22.12 on example, i can not showing nvidia-smi maybe, i used cuda 12.1...so not compatibility.... how can i use it?